UNCLASSIFIED 


AD  NUMBER 


AD867397 


NEW  LIMITATION  CHANGE 
TO 

Approved  for  public  release,  distribution 
unlimited 


FROM 

Distribution  authorized  to  U.S.  Gov't, 
agencies  and  their  contractors; 
Administrative/Operational  Use;  MAR  1970. 
Other  requests  shall  be  referred  to  Rome 
Air  Development  Center,  Attn:  EMNRS, 
Griffiss  AFB,  NY  13440. 


AUTHORITY 


RADC,  USAF  ltr,  28  jun  1973 


THIS  PAGE  IS  UNCLASSIFIED 


AD  867397 


i 


i. 


RADC-TR-  69-358 
Final  Technical  Report 
March  1970 


SYSTEM  AND  COST  EFFECTIVENESS  MANUAL 
FOR  SYSTEM  DEVELOPERS 

Lockheed  Missiles  &  Space  Company 


? 


This  document  is  subject  to  special 
export  controls  and  each  transmittal 
to  foreign  governments  or  foreign  na¬ 
tionals  may  be  made  only  with  prior 
approval  or  RADC  (F.MNRS),  GAFB, 
NY  13440. 


*  i. 


V  ' 


Rome  Air  Development  Center 
Air  Force  Systems  Command 
Griffiss  Air  Force  Bose,  New  York 


i 


I 


When  US  Government  drawings,  specifications,  or  other  data  are  used  for  any  purpose  other 
than  a  definitely  related  government  procurement  operation,  the  government  thereby  incurs 
no  responsibility  nor  any  obligation  whatsoever;  and  the  fact  that  the  government  may  have 
formulated,  furnished,  or  in  any  way  supplied  the  said  drawings,  specifications,  or  other 
data  is  not  to  be  regaioed,  by  implication  or  otherwise,  as  in  any  manner  licensing  the 
holder  or  an)  other  person  or  corporation,  or  conveying  any  rights  or  permission  to  manu¬ 
facture,  use,  rr  sell  any  patented  invention  that  may  in  any  way  be  related  thereto. 


* 


<1 


not  return  this  copy. 


Retain  or  destroy. 


W  ■ 


SYSTEM  AND  COST  EFFECTIVENESS  MANUAL 
FOR  SYSTEM  DEVELOPERS 

Allen  Chop 

Lockheed  Missiles  &  Space  Company 


This  document  is  subject  to  special 
export  controls  and  each  transmittal 
to  foreign  governments  or  foreign  na¬ 
tionals  may  be  made  only  with  prior 
approval  of  RADC  (EMNRS),  OAFB, 
NY  13440. 


« 


a****-'1- - 


FOREWORD 


This  document  is  the  Final  Report  submitted  by  Lockheed  Missiles  &  Space  Company, 
Sunnyvale,  California,  under  Contract  F30602-68-C-0209,  Project  5519,  Task.  551907, 
with  Rome  Air  Development  Center,  Griffiss  Air  Force  Base,  New  York,  Lockheed's 
report  number  ,s  DO  52535.  Jerome  Klion,  EMNRS-2,  was  the  RADC  Project  Engineer. 

This  manual  provides  procedural  and  technical  guidelines  for  the  implementation  of  system 
and  cost  effectiveness  analysis  for  different  classes  of  Air  Force  systems  throughout  any 
life  cycle  phase  during  which  design  and  technical  program  tasks  are  being  defined,  evalu¬ 
ated,  or  changed.  As  such,  the  procedures  and  techniques  contained  herein  can  be  used 
to  implement  the  general  and  specific  requirements  of  MIL-STD-499,  Military  Standard, 
System  Engineering  Management,  Additionally,  the  manual  is  responsive  to  the  primary 
objective,  policy,  and  criteria  of  Air  Force  Regulation  375-7,  Performance  Measurement 
(PM)  for  Selected  Acquisitions  and  the  information  requirements  of  Air  Force  Authorized 
Data  Item,  S-145,  System/Cost  Effectiveness  Program  Plan  of  AFSCM/AFLCM  310-1, 
Management  of  Contractor  Data  and  Reports. 

Distribution  of  the  report  is  restricted  under  the  provisions  of  the  U.S.  Mutual  Security 
Acts  of  1949. 


N. 


ABSTRACT 


The  manual  defines  and  describes  the  system  and  cost  effectivenera 
management  implementation  process  which  will  provide  both  Air  Forte 
and  contractor  management  with  the  necessary  mission  responsive  cri¬ 
teria,  authoritative  perspective,  and  visibility  for  critical  system  de¬ 
velopment  decisions.  Technical  activities,  procedures,  guidelines,  and 
objectives  for  the  efficient  and  meaningful  fcrmulatiou  uf  uliectivenesp 
criteria,  and  for  the  evaluation  and  assurance  of  effectiveness,  are  de¬ 
tailed  on  a  step-by-step  anytime  -phased,  action  basis  for  each  of  the 
systems  management  phases  of  Concept  Formulation,  Contract  Definition, 
and  Acquisition.  Further,  the  integration  of  the  effectiveness  implementa¬ 
tion  procedures  with  the  system  program  management  procedures  (AFSCM 
37-5-4)  and  systems  engineering  management  procedures  (AFSCM  375-5)  is 
outlined  for  each  major  effectiveness  activity  and  polarized  with  informa¬ 
tion  flow  networks.  Also  provided  in  the  manual  are  guidelines  for  the 
necessary  Air  Force  and  contractor  management  actions  to  implement  the 
effectiveness  process  and  to  insure  attainment  of  its  objectives.  Finally, 
specific  application  guidelines  are  detailed  for  each  of  six  major  classes 
of  Air  Force  systems  to  provide  intelligence  on  the  needed  technical  trans¬ 
lation  of  the  general  effectiveness  procedures  for  specific  applications. 
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This  program  had  as  its  abjective  the  development  of  a  manual  for 
use  during  the  various  phases  of  system  development.  It  was  the  intent 
of  the  effort  to  provide  needed  guidelines  for  both  government  and  industry 
pertinent  to  formulation  and  implementation  of  ealled-for  system  effective¬ 
ness  evaluations,  The  guidelines  in  question  were  to  be  particular  to  such 
activities  as  (1)  determination  of  appropriate1.  system  effectiveness  figures 
of  merit,  (2)  specification  of  appropriate  supporting  data  needs,  (3)  speci¬ 
fication  of  necessary  particular  technical  analyses,  and  (4)  definition  of 
practical  implementation  procedures. 


All  objectives  of  the  program  were  realized.  This  final  report 
contains  the  aforementioned  details  broken  down  for  six  particular  classes 
of  Air  Force  systems  and  subsystems  (Carmand  and  Control,  Warring  and 
Detection,  Aircraft,  Ballistic  Missile,  Booster,  and  Satellite) .  Specific 
guidelines  relative  to  analysis,  scope  and  makeup ,  data  availability  and 
sources,  and  ancillary  evaluation  activities  are  spelled  out  for  each  of 
the  three  phases  of  system  development  ( Conceptual ,  Definition,  and  Acquisition), 
Necessary  follow  through  and  coordinating  actions  between  phases  are  also 
included. 


In  addition  to  the  above,  in  order  to  integrate  system  effectiveness 
activities  with  the  other  tasks  normally  called  for  in  system  development , 
the  systeM  effectiveness  analvsis  efforts  called  for  are  coordinated  with 
pertinent  AFSCM  375  and  AFSCM  310  tasks  and  follow  the  framework  of  each 
such  task.  The  procedures  and  techniques  spelled  out  in  the  final  report  are 
also  structured  to  implement  the  general  and  specific  system  effectiveness 
activities  called  for  in  KUr-STD-499  (Bystem  Engineering  Management). 


One  of  the  pitfalls  in  the  nath  of  successful  application  of  system 
effectiveness  is  a  general  lade  of  knowledge  (or,  cm  the  other  hand, 
existence  of  erroneous  impressions)  pertinent  to  hot;  system  effectiveness 
analysis  should  be  applied  to  the  system  development  process.  The  only  way 
to  combat  this  situation  is  by  providing  documents  such  as  this  manual 
which  provide  the  necessary  knowledge  and  guidance.  This  document  is  a 
major  step  to  this  end.  It  will  be  of  aid  to  both  industry  and  government. 
Steps  are  under  way  to  combine  this  manual  and  the  completed  RADC  System/Cost 
Effectiveness  notebook  into  an  official  Air  Force  document.  (It  is  also 
possible  that  the  manual  alone  will  be,  in  the  interim,  called  cut  as  an 
exhibit  cn  all  future  APEC  systems.)  In  addition  to  this,  the  usual  DDC 
distribution  will  be  provided  this  report  such  that  it  reaches  general 
industry  in  as  short  a  +irae  period  as  possible. 
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Chapter  1 
INTRODUCTION 


Summary 

The  system  and  cost  effectiveness  technology  embodies  scientific  and  engineering 
concepts  ar.d  techniques  which  can  be  used  to  facilitate  the  creation  and  selection 
of  the  system  design  with  the  best  balance  of  technical  performance,  schedule,  and 
total  cost  to  meet  mission  and  opera  tional  requirements.  A  management  imple¬ 
mentation  process  is  identifiable  and  can  be  established,  with  distinct  technical 
elements  and  practical  procedures,  for  the  formulation  erf  effectiveness  criteria, 
and  for  the  evaluation  and  assurance  of  system  and  cost  effectiveness  in  Air  Force 
systems.  System  and  cost  effectiveness  has  a  dual  technical  meaning.  It  denotes 
a  management  science.  It  also  denotes  measurable  system  parameters  of  the 
overall  technical  performance  and  the  cost  value  or  merit  of  a  system.  The 
manual  addresses  both  >f  these  aspects  of  effectiveness,  and  is  designed  to  pro¬ 
vide  Air  Force  and  contractor  management  personnel  with  the  necessary  authori¬ 
tative  perspective  and  the  consistent  but  unrestrictive  guidelines  for  the  implemen¬ 
tation  of  the  system  and  cost  effectiveness  process.  An  emphasis  is  placed  on 
technical  elements  and  procedures  that  will  accommodate  the  normal  development, 
procurement,  and  specification  practices  of  current  system  developers.  Further, 
to  facilitate  use  of  the  manual,  implementation  and  formating  features  have  been 
incorporated.  These  include  (1)  chapter  summaries,  (2)  military  management 
phase  orientation,  (3)  technical  management  guidelines,  (4)  specialized  application 
guidelines  for  specific  classes  of  Air  Force  systems,  and  (5)  an  example  illus¬ 
trating  the  implementation  procedures. 


1-1  GENERAL 


The  system  and  cost  effectiveness  technology  Is  a  management  science  for  top- 
level  decision-making.  It  encompasses  scientific  and  engineering  concepts  and 
techniques.  When  formally  applied  early  and  periodically  throughout  a  system's 
design  life,  the  technology  can  provide  continuous  visibility  into  the  coherency 
and  proper  balance  of  a  total  system  design.  System  and  cost  effectiveness  pro¬ 
cedures  and  technical  elements  permit  a  multiplicity  of  system  design  and  use 
criteria,  such  as  mission  requirements,  technical  performance  parameters, 
design  factors,  and  resource  allocations  to  be  integrated  and  evaluated  within  a 
common  framework.  The  expedient  and  efficient  implementation  of  the  technology 
provides  a  logical  evaluation  of  how  successfully  mission  requirements  and  opera¬ 
tional  needs  are  translated  into  appropriate  systems  and  system  descriptions 
representing  the  best  combination  of  technical  performance,  schedule,  and  total 
cost. 

The  scientific  ami  engineering  foundation  of  the  system  and  cost  effectiveness 
technology  is  based  on  sound  engineering  and  management  principles,  physical 
laws,  probability  concepts,  and  empirical  relationships.  The  technology  draws 
and  builds  upon  existing  concepts  and  techniques  employed  by  the  highly  comple¬ 
mentary  and  creative  systems  engineering  disciplines  that  it  integrates.  A  manage¬ 
ment  process  can  be  defined  and  established  for  the  practical  implementation,  of 
the  system  and  cost  effectiveness  technology  during  the  conceptual,  definition,  v. 
development,  and  operational  evolutionary  phases  of  Air  Force  military  systems.  ^ 
Identifiable  With  this  management  implementation  process  is  a  distinct  series  of 
activities.  These  activities  consist  of  technical  elements  and  procedures  for  the 
formulation  of  criteria,  and  for  the  evaluation  and  assurance  of  system  and  cost 
effectiveness. 

In  addition  to  its  role  as  a  management  science,  system  and  cost  effectiveness 
denotes  measurable  system  parameters  representing  the  conglomerate,  interactive 
influences  of  the  diverse  technical,  schedule,  and  cost  parameters  cf  a  system. 
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In  this  context,  system  effectiveness  refers  to  a  quantitative  measure  of  the  extent 
to  which  a  system  may  be  expected  to  achieve  a  set  of  specific  mission  requirements. 
It  is  a  measure  of  the  technical  performance  values)  or  merits)  of  the  system  to 
achieve  specific  mission  and  operational  requirements.  A  cost  effectiveness 
measure  relates  the  system  effectiveness  measure  (value  received)  to  the  resource 
cost. 


1-2  PURPOSE  OF  MANUAL 

This  Air  Force  manual  serves  multi -purposes.  However,  the  primary  intent  is  to 
meet  the  technical  need  for  a  general  management  manual  which  will  provide  con¬ 
sistent,  but  unrestrictive,  guidelines  and  procedural  guidance  for  accomplishing 
,  the  necessary  actionc  in  implementing  a  system  and  cost  effectiveness  process  by 
both  Air  Force  technical  and  procuring  activities  and  industrial  contractors.  Con¬ 
sistent  with  this  purpose,  the  manual  describes  specific  technical  elements  with 
associated  procedures  that  can  be  validly  and  effectively  applied  on  a  step-by-step 
basis  to  all  major  classes  of  Air  Force  systems.  The  technical  elements  are 
addressed  to  fundamental  aspects  of  the  system  and  cost  effectiveness  management 
implementation  process.  These  aspects  are: 

•  the  formulation  of  effectiveness  criteria 

•  the  evaluation  of  effectiveness 

•  the  assurance  of  effectiveness  progress  and  achievement 

\ 

The  system  and  cost  effectiveness  technology  is  broad  and  complex.  It  encompasses 
and  operates  on  diverse,  but  complementary,  technologies  and  engineering  disci¬ 
plines.  An  authoritative  perspective  and  a  basic  understanding  of  the  technology  by 
Air  Force  and  contractor  management -level  personnel  are  vital  prerequisites  for  its 
valid  application.  The  manual  is  designed  to  provide  this  penetrating  management 
visibility  as  well  as  to  establish  a  technical  base  for  the  specialists  who  are  respon¬ 
sible  for  the  creative  and  innovative  application  of  the  technology. 


The  manual  emphasizes  technical  elements  and  procedures  that  are  consistent  with 
technical  activities  common  to  current  development,  procurement,  and  specifica¬ 
tion  practices  of  system  developers.  For  example,  while  it  is  expected  that  the 
system  effectiveness  parameter  will  be  introduced  into  top-level  system  specifica¬ 
tions  as  a  new,  specialty  parameter  which  measures  the  collective  contribution  to 
the  system  of  its  critical  functional  and  specialty  technical  performance  parameters, 
its  introduction  is  not  expected  to  change  the  current  practice  of  separately  specify¬ 
ing  and  evaluating  these  system  parameters.  Furthermore,  the  analytical  tech¬ 
niques,  procedures,  and  data  sources  detailed  in  this  manual  will  be  readily  recog¬ 
nizable  by  managers  of  any  of  the  multi -specialty  disciplines  of  the  applied  science 
of  systems  engineering  as  being  congruous  with  current  technical  activities.  It  is 
the  formalizing,  restaging,  and  redirecting  of  these  related  technical  activities  to 
obtain  an  optimum  balance  of  technical  performance,  schedule ,  and  total  cost  that 
is  the  challenging  and  creative  goal  of  the  system  and  cost  effectiveness  management 
implementation  process. 

The  forr.  I  implementation  of  the  effectiveness  management  process  will  facilitate 
the  transfer  and  cascade  of  consistent  and  critical  system  information  and  decisions 
from  one  phase  of  the  system  management  process  to  another.  For  example,  the 
results  of  gross  trade-off  studies  performed  on  critical  system  parameters  during 
the  Concept  Formulation  phase  as  part  of  a  gross  effectiveness  analysis  will  be 
available  for  expansion  and  refinement  during  the  Contract  Definition  phase.  Con¬ 
sequently,  an  additional  purpose  of  the  manual  is  to  ensure  the  formalizing  and 
availability  cf  this  continuum  of  objective,  systom -level  information  and  decisions 
throughout  a  system's  life  cycle. 

In  principle,  it  is  the  objective  of  the  system  and  cost  effectiveness  technology  to 
determine  the  interactive  influence  «f  the  array  of  system  functional  and  specialty 
technical  parameters.  While  current  knowledge  may  not  support  an  in-depth  analysis 
of  all  such  interactions,  it  is  the  further  intention  of  the  manual  to  provide  visibility 
of  the  pertinent  technical  considerations  and,  where  feasible,  means  for  determining 
the  quantitative  effects.  Therefore,  the  effectiveness  elements  and  procedures 
described  in  the  manual  are  intended  to  be  unrestrictively  and  selectively  applied, 
with  alternate  techniques  to  be  developed  and  used  if  existing  data  do  not  fully  support 
the  application  of  these  elements  and  procedures. 


1-3  USE  OF  MANUAL 


To  accommodate  a  wide  readership  within  Air  Force  activities  and  industrial  con¬ 
cerns,  and  to  facilitate  technical  continuity,  understanding,  and  ease  of  usage, 
implementation  and  formating  features  have  been  incorporated.  Some  of  these  are 
chapter  summaries,  military  management  phase  orientation,  technical  management 
guidelines,  specialized  application  guidelines  for  specific  classes  of  Air  Force 
systems,  and  an  example  illustrating  the  implementation  procedures. 

Chapter  Summaries 

Each  chapter  begins  with  a  summary.  This  will  allow  the  users  to  obtain  rapidly  a 
broad  perspective  of  the  technical  elements  and  procedures  involved  in  the  imple¬ 
mentation  process.  Also,  a  segmented  flow  chart  is  included  for  each  effectiveness 
element  described  to  provide  technical  continuity  and  to  summarize  input-output 
information  flow. 

Phase  -Oriented  Structure 

The  manual  is  oriented  to  the  military  management  phases  of  Concept  Formulation, 
Contract  Definition,  and  Acquisition.  The  effectiveness  management  implementation 
activities  applicable  to  each  of  these  phases  are  detailed  and  integrated  with  the 
phase -related  system  program  management  procedures  delineated  in  AFSCM  375-4  and 
the  systems  engineering  management  procedures  of  AFSCM  375-5.  A  general  know¬ 
ledge  of  these  procedures  is  necessary  for  a  full  technical  understanding  of  the  inter¬ 
actions  and  complementations  of  the  effectiveness  management  process  with  the  system 
program  and  systems  engineering  management  processes. 

Technical  Management  Guidelines 

The  implementation  of  the  system  and  cost  effectiveness  technology  is  a  Government 
and  contractor  participating  development,  with  each  of  the  parties  having  specific 
primary  responsibilities  for  its  execution.  Accordingly,  technical  program  manage¬ 
ment  guidelines  are  provided  in  the  following  areas  of  responsibility: 
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Government 


•  The  determination  and  specification  of  the  appropriate  system 
and  cost  effectiveness  measures 

•  The  establishment  and  specification  of  the  data  needed  to  document, 
and  to  provide  visibility  and  confidence  of,  overall  system  progress 
towards  meeting  technical  goals  and  requirements 

•  The  specification  of  the  required  technical  analyses  for  credible 
and  defensible  effectiveness  evaluations 

Contractor 

•  The  implementation  of  the  effectiveness  process 

•  The  establishment  of  sufficient  and  valid  data  sources  with  maximum 
utility  for  effectiveness  evaluations 

•  The  establishment  of  organization,  management,  and  data  feedback 
plans  for  effectiveness  evaluations  and  dynamic  monitoring  of  progress 
towards  achievement  of  effectiveness  objectives 

Specialized  Application  Guidelines 

General  procedures  applicable  to  multi -classes  of  Air  Force  systems  are  provided 
for  each  technical  element  of  the  effectiveness  implementation  process  for  each 
system  management  phase.  These  general  procedures  require  a  technical  transla¬ 
tion  for  each  specific  application,  to  accurately  represent  the  technical  characteris¬ 
tics  of  the  system  and  the  circumstances  surrounding  its  development,  and  use. 
Accordingly,  a  chapter  is  included  in  the  manual  of  specialized  application  guidelines 
useful  for  the  formulation  of  effectiveness  criteria  and  for  the  effectiveness  evaluation 
of  specific  classes  of  Air  Force  systems. 

Example  of  Implementation  Procedures 

An  example  is  presented  in  Appendix  A  to  demonstrate  and  illustrate  the  effective  ¬ 
ness  technical  elements  and  procedures  described  in  the  manual.  The  example 
addresses  the  effectiveness  formulation  ami  evaluation  process  for  the  Concept 


Formulation  Phase  as  applied  to  a  transport  aircraft  system  with  multiple  mission 
objectives.  The  c-xample  preserves  and  illustrates  the  step-by-step  sequence  of 
activities  for  this  phase  described  in  Chapter  3.  An  extension  of  the  example  to 
illustrate  the  procedures  described  in  Chapters  4  and  5  for  the  Contract  Definition 
and  Acquisitions  Phases  involves  die  incorporation  of  additional  complexities, 
such  as  design  details  and  other  effectiveness  activities,  and  then  iterating  the 
basic  procedures  covered  in  the  example.  In  consideration  of  the  useful  value  of 
a  simple  example,  these  complexities  are  not  introduced. 

System/Cost  Effectiveness  Notebook 

Since  the  manual  is  designed  to  provide  a  broad  overview  of  the  technical  elements 
and  procedures  associated  with  the  effectiveness  management  implementation 
process,  specific  technical  concepts,  methodologies,  and  data  useful  for  effective¬ 
ness  analyses  are  not  expanded  in  detail  herein.  Such  detail  information  useful  to 
technical  specialists  responsible  for  conducting  effectiveness  analyses  and  appli¬ 
cation  of  the  technology  is  contained  in  the  System/ Cost  Effectiveness  Notebook, 
RADC-TR-68-352,  a  document  directly  applicable  as  a  technical  supplement  to 
this  manual. 

1-4  ABBREVIATIONS  AND  DEFINITIONS  OF  TERMS  USED 
ABBREVIATION 

AAE  -  Aerospace  Ancillary  Equipment 
ADC  -  Air  Defense  Command 
AFLC  -  Air  Force  Logistics  Command 
AFSC  -  Air  Force  Systems  Command 
AGE  -  Aerospace  Ground  Equipment 
AVE  -  Aerospace  Vehicle  Equipment 
CDP  -  Contract  Definition  Phase 
CDR  -  Critical  Design  Review 
CEI  -  Contract  End  Item 

CFP/TDP  -  Concept  Formulation  Package/Technical  Development  Plan 

FA  Cl  -  First  Article  Configuration  Inspection 

FOM  -  Figure  of  Merit 

MGE  -  Maintenance  Ground  Equipment 
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OGE  -  Operating  Ground  Equipment 

PBS  -  Program  Work  Breakdown  Structure 

PDE  -  Preliminary  Design  Review 

PSPP  -  Proposed  System  Package  Program 

RAD  -  Requirements  Action  Directive 

RAS  -  Requirements  Allocation  Sheet 

RDT&E  -  Research,  Development,  Test,  and  Evaluation 

RFP  -  Request  For  Proposal 

ROC  -  Required  Operational  Capability 

SAC  -  Strategic  Air  Command 

SDD  -  System  Definition  Directive 

SOW  -  Statement  of  Work 

SPD  -  System  Program  Directive 

SPO  -  System  Program  Office 

SPP  -  System  Package  Program 

TAC  -  Tactical  Air  Command 

TAD  -  Technical  Approval  Demonstration 

TPM  -  Technical  Performance  Measurement 

WBS  -  Work  Breakdovm  Structure 

DEFINITION 

Availability  -  A  measure  of  the  condition  of  the  system  at  the  start  of  the 
mission  at  any  point  in  time. 

Accountable  Factor  -  A  physical  or  functional,  specialty,  or  operational  design 
variable  influencing  one  or  more  top-level  system  performance  parameters.  In 
a  general  context  for  any  level  of  system  design,  it  is  any  input  variable  influenc¬ 
ing  one  or  more  output  variables  or  parameters. 

Capability  -  A  measure  of  the  ability  of  a  system  to  achieve  the  mission  objec¬ 
tives;  given  the  system  conditions)  during  the  mission,  and  specifically  accounts 
for  the  performance  spectrum  of  a  system. 

Cost  Effectiveness  -  A  measure  of  the  performance  value  received  (system 
effectiveness)  for  the  resource  expended  (cost). 
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Dependability  -  A  measure  of  the  system  condition  at  one  or  more  points  during 
the  mission;  given  the  system  conditions)  at  the  start  of  the  mission,  and  may 
be  stated  as  the  probability  that  the  system  will  enter  and/or  occupy  any  one 
of  its  significant  states  during  a  specific  mission. 

Effectiveness  Parameter  -  A  parameter  such  as  an  availability,  dependability, 
or  capability  measure  directly  related  to  a  top-level  Figure  of  Merit  measure, 
usually  compositing  a  set  of  measurable  system  performance  parameters  to 
which  it  can  be  technically  traced. 

Effectiveness  Technical  Element  -  A  major,  identifiable  technical  activity  of 
the  system  and  cost  effectiveness  management  implementation  process. 

Figure  of  Merit  -  A  measure  of  system  effectiveness  pertinent  to  one  or  more 
mission  requirements. 

Performance  Parameter  -  A  physical  or  functional,  specialty,  or  operational 
technical  parameter  normally  appearing  in  Section  3. 1,  PERFORMANCE,  of  the 
system  specification,  and  describing  a  measurable,  terminal  characteristic 
of  a  system  that  can  be  observed. 

Specialty  Technical  Parameter  -  A  performance  parameter  addressing  a  specialty 
engineering  discipline,  such  as  the  human  factor,  maintainability,  penetrability, 
reliability,  safety/security,  survivability,  or  vulnerability  parameter. 

System  Effectiveness  -  A  measure  of  the  extent  to  which  a  system  may  be 
expected  to  achieve  a  set  of  specific  mission  requirements,  and  which  may  be 
expressed -as  a  function  of  availability,  dependability,  and  capability.  It  is  a 
measure  of  the  technical  performance  value(s)  or  merits)  of  a  system. 

Transfer  Function  -  A  mathematical  representation  of  a  functional  cause-and- 
effect  relationship  of  system  performance  behavior  and  is  based  on  physical 
laws,  theoretical  and  empirical  design  equations,  or  probability  concepts. 


Chapter  2 
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OVERVIEW  OF  THE  SYSTEM  AND  COST 
EFFECTIVENESS  TECHNOLOGY 


Summary 

The  system  and  cost  effectiveness  technology  Is  applied  throughout  the  life  of  a 
system.  While  the  effectiveness  parameter  has  a  dominant  technical  characteristic, 
the  technology  is  implemented  as  a  subprocess  of  the  system  program  management 
process  and  is  interactive  with  the  systems  engineering  management  process.  A 
general  overview  is  presented  cf  the  effectiveness  management  implementation  pro¬ 
cess  and  its  integration  with  these  processes  which  are  detailed  in  AFSCM  375-4  and 
AFSCM  375-5,  respectively.  The  interactions  of  the  three  processes  are  summar¬ 
ized  in  time-phased  networks  for  the  Concept  Formulation,  Definition,  and  Acquisi¬ 
tion  Phases  of  systems  management.  Technical  goals  of  the  system  and  cost 
effectiveness  activities  are  highlighted  for  these  phases,  and  a  compendium  of  the 
activities,  their  purposes,  and  their  use  is  provided.  The  general  concept  of  system 
and  cost  effectiveness  me  asures  to  provide  objective  criteria  and  continuous  manage¬ 
ment  visibility  for  critical  system  selection,  development,  and  operational  decisions 
is  described.  Figures  of  Merit  as  measures  of  system  effectiveness  also  are  de¬ 
scribed,  including  their  utility  during  each  phase  of  systems  management  and  their 
general  applicability  to  different  system  levels. 


3-1  GENERAL 


The  technical  and  management  activities  of  the  system  and  cost  effectiveness 
technology  are  integral  elements  of  the  Air  Force  system  program  management  and 
systems  engineering  management  procedures  described  in  AFSCM  375-4  and  375-5, 
respectively.  The  general  contributions  of  the  effectiveness  technology  to  both  proc¬ 
esses  are  described  in  these  documents.  The  specific  manner  in  which  this  tech¬ 
nology  can  be  implemented  on  a  time-phased  and  practical  basis  for  multi-classes  of 
Air  Force  systems  has  been  the  subject  of  major  Air  Force  development  activities  in 
recent  years.  To  a  large  extent,  the  content  of  this  manual  represents  the  results  of 
these  activities.  General  and  specific  procedural  guidelines  are  prescribed  for  the 
implementation  of  the  system  and  cost  effectiveness  management  process.  In  principle 
and  in  practice,  these  guidelines  are  designed  to  be  non-duplicative  of  existing  pro¬ 
cedures  and  activities  of  the  AFSCM  375-4  and  375-5  networks.  Additionally,  the 
implementation  guidelines  are  structured  to  maximize  the  use  of  data  which  are  nor¬ 
mally  generated  and  required  for  executing  the  procedures  of  these  existing  networks, 
thus  providing  for  ease  and  efficiency  of  implementation  at  the  technical  management 
level.  Because  of  the  broad  nature  of  the  system  and  cost  effectiveness  technology,  a 
knowledgeable  perspective  is  required  of  (1)  its  technical  roles ,  (2)  the  basic  imple¬ 
mentation  concepts  and  considerations  involved,  (3)  the  interrelations  of  its  specialized 
and  general  elements  and  procedures,  and  (4)  the  mutual  contributions  of  the  effective¬ 
ness,  system  management,  and  systems  engineering  management  processes  toward  the 
creation  and  selection  of  military  systems  with  maximum  effectiveness  to  the  using 
commands.  The  application  of  the  system  and  cost  effectiveness  technology  throughout 
a  system' s  life  will  provide  management  visibility  and  information  on  a  continuous 
basis  for  critical  development  and  operational  decisions.  It  is  vital,  therefore,  to 
implement  the  effectiveness  management  process  as  early  as  possible  in  the  Concept 
Formulation  Phase  to  insure  that  a  system  will  evolve  with  the  best  balance  of  technical 
performance,  schedule  demands,  and  total  cost  to  meet  specific  mission  objectives 
and/or  to  improve  military  force  effectiveness.  The  useful  power  of  the  effectiveness 
process,  especially  the  effectiveness  analysis  activity,  will  diminish  if  initial  imple¬ 
mentation  is  deferred  to  a  subsequent  phase. 
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2-2  INTEGRATED  SYSTEM  AND  COST  EFFECTIVENESS  AND  SYSTEMS  MANAGEMENT 
NETWORKS 


The  system  and  cost  effectiveness  process  with  its  technical  elements  and  procedures 
integrates,  augments,  and  lends  direction  to  the  technical  actions  of  the  system  pro¬ 
gram  management  and  systems  engineering  management  processes.  The  manner  in 
which  this  is  accomplished  on  a  time-phased  ba  is  is  sir  vn  m  Figures  2-1,  2-2,  and 
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2-3.  These  integrated  networks  provide  a  genet  »v  < 

dependencies  of  the  three  processes  during  the  Cor 
Acquisition  Phases  of  systems  mar:;  ve  orient.  ■ 
system  program,  and  systems  engineering  ■ 
one  program  application  to  another.  The  a  i 
specifically  related  to  the  AFSCM  375-4  and 
However,  comparable  relationships  exist,  and  r 
effectiveness  process  and  any  well -disciplined  and  ,  .,1 
systems  engineering  management  effort,  since  only  inivers.. 
been  included  in  the  networks  and  expanded  in  detail  in  the  mail  ,a.  Additionally,  the 
effectiveness  process  shown  relates  principally  to  the  system  effectiveness  portion  of 
the  system  and  cost  effectiveness  technology,  namely  the  aspect  of  the  technology  that 
provides  visibility  of  technical  performance  adequacy  as  contrasted  to  cost  performance. 
This  is  not  to  be  interpreted  as  an  exclusion  of  cost  performance  in  the  overall  analysis, 
but  an  emphasis  of  the  system  effectiveness  technical  elements  and  procedures  because 
of  their  complexity,  their  cross -process  interactions,  and  their  vital  contributions  to 
the  achievement  of  technically  efficient  military  systems.  From  a  technical  and  man¬ 
agement  viewpoint,  the  sepaiately  shc">m  effectiveness  process  can  be  considered  as  a 
prominent  sub-network  of  the  systems  engineering  management  network  with  overlaps 
into  the  system  program  management  network. 


The  system  and  cost  effectiveness  process  is  dynamic  in  nature,  increasing  in  scope 
and  utility  as  a  system  progresses  from  concept  formulation  through  acquisition  and 
operational  turn -over  to  the  using  command  or  agency.  During  the  Concept  Formulation 
Phase,  the  activities  of  the  process  are  primarily  directed  towards: 

•  The  definition  of  the  mission  in  terms  of  quantifiable,  specific  objectives  and 
anticipated  mission  conditions  expected  to  influence  system  performance. 
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Concept  Formulation  Phase 
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-  START  ACQUISITION  PHASE 


•  The  formulat'on  of  broad  effectiveness  criteria,  including  preliminary  Figures 
of  Merit  and  cost  effectiveness  measures,  to  provide  a  comparison  and  evalu¬ 
ation  basis  for  the  creation  and  selection  of  the  best  system  concepts). 

•  The  gross  identification  of  system  performance  parameters  expected  tc  criti¬ 
cally  influence  system  effectiveness. 

•  The  structuring  of  a  gross  analytical  mode,  for  use  in  effectiveness  analyses. 

•  The  system  and  cost  effectiveness  analysis  of  the  candidate  concepts  to  factually 
establish  their  technical  ability  and  econorpy  to  meet  military  needs,  the  degree 
of  technical  and  resource  risks  involved,  and  the  critical  design  areas  expected. 

•  The  reporting  of  the  analysis  rationale  and  the  criteria  formulation  and  evalu¬ 
ation  results. 

During  the  Contract  Definition  Phase  of  systems  management,  the  system  and  cost  effec¬ 
tiveness  process  is  primarily  directed  towards: 

•  The  establishment  of  quantitative  system  and  cost  effectiveness  measures  for 
each  mission  objective.  Each  system  effectiveness  measure  is  denoted  as  a 
principal  Figure  of  Merit. 

•  The  apportionment  of  the  Figures  of  Merit.  At  the  top  system  level  (e.  g. ,  a 
military  force  structure  consisting  of  one  or  more  major  systems,  such  as  a 
strategic  aircraft  Wing  composed  of  an  air-to-ground  missile  system,  a  bomber 
aircraft  system,  and  a  ground  support  system).  Figures  of  Merit  can  be  de¬ 
fined  and  allocated  to  each  type  of  constituent  system  to  represent  a  system's 
particular  contributions  to  each  of  the  mission  objectives.  Additionally,  an 
apportionment  of  the  first -level,  system  Figures  of  Merit  can  be  accomplished 
by  translating  the  Figures  of  Merit  into  subsystem  Figures  of  Merit  or  limiting 
values  on  the  functional  and  specialty  performance  parameters  of  the  system. 

A  further  extension  of  the  apportionment  process  to  the  design  accountable 
factors  with  critical  influence  on  these  system  parameters  can  then  be  accom¬ 
plished  as  design  details  permit. 

•  The  establishment  of  system  and  cost  effectiveness  models  and  submodels  to 
provide  the  analytical  analog  of  the  influence  of  system  parameters  and  accounta 
ble  factors  on  the  effectiveness  measures. 


•  The  determination  of  data  availability  for  the  required  analyses,  ana  the 
identification  of  the  data  sources. 

•  The  identification  of  the  system  parameters  and  their  first-level  accountable 
factors  critical  to  effectiveness,  and  definition  of  their  sensitivity  and  func¬ 
tional  cause -and -effect  relationships. 

•  The  analysis  of  system  effectiveness  for  each  feasible  design  configuration 
or  design  approach  to  determine  its  current  effectiveness  and  predicted  ef¬ 
fectiveness  growth  potential  within  schedule  constraints. 

•  The  analysis  of  cost  effectiveness  for  each  feasible  design  configuration  or 
design  approach  to  determine  total  system  cost,  including  development  cost, 
acquisition  cost,  and  operational  cost  associated  with  manning,  operating, 
maintaining,  and  logisticaLy  supporting  the  system. 

•  The  formulation  of  an  effectiveness  progress  monitoring  and  demonstration 
plan. 

•  The  reporting  of  the  defined  system  and  cost  effectiveness  criteria  baseline, 
analysis  rationale,  and  evaluation  results. 

With  the  onset  of  the  Acquisition  Phase,  the  system  configuration  baseline  which  is 
anticipated  to  provide  the  optimum  balance  of  performance,  time,  and  cost  will  have 
been  established.  Additionally,  the  principal  Figures  of  Merit,  effectiveness  param¬ 
eters,  and  critical  system  performance  parameters  will  have  been  defined  and  ap¬ 
portioned,  the  critical  accountable  factors  of  the  design  identified,  and  models  devel¬ 
oped  for  computing  effectiveness  measures.  During  this  phase,  system  and  cost 
effectiveness  activities  primarily  are  addressed  to: 

•  The  re-evaluation  and  re -selection  of  the  system  performance  parameters 
and  their  required  parameter  values  affecting  the  Figures  of  Merit. 

•  The  refinement  of  effectiveness  models  and  submodels,  including  the  develop¬ 
ment  of  computer  simulation  or  other  analysis  routines,  and  the  validation 
and  re -examination  of  assumptions  to  increase  model  precision. 

•  The  integration  of  submodels  by  the  prime/ integrating  contractor  with  models 
of  the  subcontractor/associ&te  contractors,  including  the  establishment  of 
effectiveness  analysis  standard*  And  guidelines. 
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•  The  reapportionment  of  effectiveness  parameters,  system  performance 
parameters,  and  critical  accountable  factors  as  required. 

•  The  identification  of  accountable  factors  to  the  ne^t  lower  level. 

•  The  analysis  of  the  system  configuration  to  determine  current  and  predicted 
effectiveness  status,  and  the  monitoring  of  the  convergence  progress  at  criti¬ 
cal  system  performance  parameters,  effectiveness  parameters,  and  Figures 
of  Merit  to  their  targeted  values. 

•  The  analysis  of  engineering  changes  for  effectiveness  implications. 

•  The  demonstration  of  Figures  of  Merit  achievement. 

•  The  final  reporting  of  effectiveness  results. 

Table  2-1  presents  a  compendium  of  the  effectiveness  technical  activities  (elements), 
the  principal  purposes  of  the  activities,  and  their  main  contributions  to  system  pro¬ 
gram  management  and  systems  engineering  management  activities. 

2-3  SYSTEM  AND  COST  EFFECTIVENESS  MEASURES 

The  objective  of  the  Air  Force  military  management  process  is  to  develop  systems 
which  are  optimum  in  terms  of  performance  capability  to  meet  current  and  future  needs 
for  the  resources  applied.  System  and  cost  effectiveness  measures  are  usable  to  pro¬ 
vide  quantitative  estimates  of  how  well  a  system  can  meet  this  objective.  System  ef¬ 
fectiveness  denotes  a  measure  of  the  extent  to  which  a  system  may  be  expected  to 
achieve  a  set  of  specific  mission  requirements.  A  Figure  of  Merit  is  a  measure  of 
system  effectiveness  pertinent  to  one  or  more  mission  requirements  of  the  set.  Cost 
effectiveness  is  the  measure  of  system  effectiveness  relative  to  resource  cost. 

The  system  and  cost  effectiveness  measures  are  used  to  provide  a  composite  display 
of  the  extent  to  which  an  optimum  mission-system  match  is  achieved  for  the  resources 
applied.  These  measures  are  versatile  indices  with  multiple  decision-making  usage 


TABLE  2-1  COMPENDIUM  OF  SYSTEM  AND  COST  EFFECTIVENESS  ACTIVITIES 


Activity 


Purpose 


Principal  Use 


•  Mission 
Analysis 


CONCEPT  FORMULATION  PHASE  I  | 

.  . . . . . . -  „.,i  | 


To  define  the  missions 
in  terms  of  quantifiable 
specific  objectives  and 
anticipated  mission 
conditions 


For  inclusion  in  the  RAD 
and  CFP/TDP,  for  es¬ 
tablishing  preliminary 
FOMs,  and  for  updating 
ROC 


•  Specifying 
Preliminary 
Figures  of  Merit 


To  provide  a  technical 
comparison  and  evalu¬ 
ation  basis  for  selection 
of  the  system  concept 
with  optimum  balance  of 
performance  effectiveness 
and  cost 


For  inclusion  in  RAD  and 
CFP/TDP,  for  effective¬ 
ness  analysis  of  system 
concepts,  and  decision 
criteria  for  system 
creation  and  selection 


•  Performance 
Requirements 
Analysis 


To  translate  mission 
parameters  to  gross 
system  functions  and 
system  performance 
requirements 


For  analyzing  basic 
mission/ system  relation¬ 
ships,  for  documenting 
initial  effectiveness  de¬ 
cisions,  for  establishing 
system  performance 
parameters  critical  to 
the  preliminary  FOMs, 
and  for  inclusion  in 
CFP/TDP 


•  Operational  To  translate  mission 

Requirements  operational  requirements 

Analysis  to  gross  system  manning, 

operations,  maintenance, 
and  logistic  support 
requirements 


For  analyzing  basic 
operational/ system  re¬ 
lationships,  for  docu¬ 
menting  initial  effective¬ 
ness  decisions,  for 
establishing  system 
operational  parameters 
critical  to  the  preliminary 
FOMs,  and  for  inclusion 
in  CFP/TDP 


•  Effectiveness 
Parameter 
Selection 


To  define  and  relate  sys¬ 
tem  parameters  critical 
to  FOMs 


For  inclusion  in  CFP/TDP 
and  for  effectiveness 
evaluations 
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TABLE  2-1  COMPENDIUM  OF  SYSTEM  AND  COST  EFFECTIVENESS  ACTIVITIES 
(Continued) 


Activity 


Purpose 


Principal  Use 


•  Model 

Structuring 


To  establish  mathematical 
and  simulation  analogs  re¬ 
lating  system  and  effective¬ 
ness  parameters  to  FOMs 


For  inclusion  in  CFP/TDP 
and  for  evaluation  of  sys¬ 
tem  and  effectiveness  param¬ 
eters  and  FOMs 


•  System  and  Cost 
Effectiveness 
Analysis 

To  evaluate  overall  balance 
of  performance,  schedule, 
and  cost  for  each  system 
concept 

For  inclusion  in  CFP/TDP, 
for  highlighting  critical  ef¬ 
fectiveness  design  problems 
and  risks  as  criteria  for 
system  comparisons,  and 
for  justification  of  system 
selection 

•  Report 

To  provide  compendium  of 

For  inclusion  in  CFP/TDP, 

effectiveness  formulation 

for  updating  erf  the  RAD, 

and  evaluation  results  and 

and  for  preparation  of 

rationale 

Definition  Plan 

I  CONTRACT  DEFINITION  PHASE  1 


•  Effectiveness 
Analysis 
Refinement 


To  update,  refine,  and 
extend  the  activities  pre¬ 
viously  initiated  in  CFP 


For  guiding  trade-off 
studies  in  shaping  design 
solutions,  for  guiding 
parameter  tracking  and 
demonstration  planning, 
for  highlighting  critical 
design  problems  and 
technical/cost  risk  areas, 
and  for  inclusion  in  the 
PSPP 


•  Apportionment 
Analysis 


To  establish  traceability 
and  to  define  allocations 
of  system  and  subsystem 
functional  and  specialty 
performance  parameters 


For  inclusion  into  system 
and  detailed  CEI 
specifications 


TABLE  2-1  COMPENDIUM  OF  SYSTEM  AND  COST  EFFECTIVENESS  ACTIVITIES 
(Continued) 


Activity 


Purpose 


Principal  Use 


•  Effectiveness 
Progress 
Monitoring  and 
Demonstration 
Planning 


To  define  the  essential 
system  parameters  and 
their  expected  conver¬ 
gence  profile  which  are 
to  be  tracked,  and  the 
parameters  to  be 
demonstrated 


For  preparation  of  the 
PSPP,  for  Category  n 
and  in  and  TAD  test 
planning, and  for  providing 
current  visibility  of 
progress  during 
Acquisition 


•  Report 


To  provide  compendium 
of  the  updated,  refined, 
and  extended  effectiveness 
analysis  results 


For  updating  of  the  TDP 
and  for  preparation  of  the 
PSPP  and  other  baseline 
documents 


ACQUISITION  PHASE 


•  Detail 

Effectiveness 

Analysis 


To  provide  current  and 
predicted  estimates  of 
system  and  cost  effec¬ 
tiveness  on  a  continuing 
basis  as  significant  de¬ 
sign  details  are  developed 
on  product  configuration, 
or  as  performance  require¬ 
ments  are  changed. 


To  guide  trade-off  deci¬ 
sions  in  shaping  detail 
design  solutions,  to  evalu¬ 
ate  current  and  predicted 
system  and  cost  effective¬ 
ness  status  as  design 
progresses,  and  to  reap¬ 
portion  effectiveness  and 
system  parameters  as 
needed  for  optimum  cost- 
performance -time  balance. 


•  Effectiveness 
Progress 
Monitoring  and 
Demonstration 


To  provide  a  current 
assessment  of  technical 
progress  in  meeting  re¬ 
quirements  and  goals  on 
effectiveness -related 
parameters  and  measures. 


To  provide  management 
visibility  of  technical 
progress  on  effectiveness 
growth,  critical  problems 
ami  high  risk  areas  re¬ 
quiring  timely  attention, 
and  demonstrated  per¬ 
formance  results  under 
operational  conditions. 


TABLE  2-1  COMPENDIUM  OF  SYSTEM  AND  COST  EFFECTIVENESS  ACTIVITIES 
(Continue*!) 


Activity 

Purpose 

Principal  Use 

•  Final 

Report 

To  provide  the  SPO  with 
a  compendium  of  the  final 
effectiveness  baseline  used 
for  analyses,  achieved 
versus  required/targeted 
effectiveness  objectives, 
and  system  improvement 
potentials  for  effective¬ 
ness  growth. 

To  determine  whether 
effectiveness  goals  have 
been  met,  the  extent  that 
operational  tactics  are 
affected  by  final  results, 
and  validation  of  areas 
requiring  engineering 
modifications. 

NOTE:  See  Chapter  1,  paragraph  1. 4  for  explanation  of  abbreviations. 


depending  upon  the  system  evolution  p  to  which  they  are  applied.  For  example, 
effectiveness  measures  are  usable  for  l.  ollowing  purposes: 

Concept  Formulation 

•  Determination  of  the  best  system  performance  and  cost  mix  in  terms  of  a 
defined  standard  (e.  g. ,  threat,  resource,  strike  capability)  during  Explora¬ 
tory  and  Advanced  Development 

•  Identification  of  the  degree  to  which  innovations  should  be  pursued 

•  Evaluation  of  candidate  system  concepts  for  selection  of  the  preferred 
system 

•  Guide  definition  of  preferred  system(s) 

•  Determination  of  optimum  force  level  and  operational  concepts 

•  Comparison  of  existing  systems  with  proposed  systems 

Contract  Definition  Phase 

•  Guide  trade-off  analysis 

•  Determination  of  the  critical  and  limiting  parameters  and  priorities  in  terms 
of  technical  and  mission  objectives 

o  Evaluation  of  candidate  configurations  of  the  chosen  system  concept 

•  Guide  definition  of  operational  policies  and  tactics 

•  Guide  preliminary  design  activities 

•  Provide  visibility  of  critical  problem  and  high  risk  areas 
Acquisition  Phase 

•  Guide  trade-off  and  engineering  change  analysis  at  detail  design  levels 

•  Establishment  of  design  criteria  for  optimum  performance  effectiveness 

•  Guide  areas  requiring  design  concentration 

•  Evaluation  of  progress  in  meeting  design  objectives  on  an  amalgamated  basis 

Many  Air  Force  systems  Isave  more  than  one  mission  and  will  require  more  than  one 
Figure  of  Merit,  The  multi -mission  characteristics  of  some  systems  are  shown  in 
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Table  2-2.  Figures  of  Merit  are  mission -oriented  and  relate  to  the  extent  that  a 
system  can  accomplish  each  of  its  mission  assignments.  Effectiveness  measures, 
therefore,  should  be  in  the  form  of  narrative  descriptions  capable  of  being  quantified 
into  Figures  of  Merit.  Technical  performance  parameters  of  a  system,  such  as 
logistics  parameters,  navigation  accuracy,  target  recognition  capabilities,  weapon 
delivery  accuracy,  range,  power,  maintainability,  vulnerability,  reliability,  etc. , 
have  considerable  effects  on  the  mission  and  are  collectively  considered  in  establish¬ 
ing  Figures  of  Merit.  Individually,  these  parameters  are  insufficient  as  measures  of 
the  overall  performance -cost  merits  of  a  system  in  that  they  cannot  be  singularly 
optimized  without  influencing  the  other  technical  parameters  of  the  system. 

System  effectiveness  may  be  expressed  as  a  function  of  three  (3)  effectiveness  param¬ 
eters  of  availability,  dependability,  and  capability.  The  following  interpretation  of 
these  parameters  applies  in  general: 

•  Availability 

A  measure  of  the  condition  of  the  system  at  the  start  of  the  mission  at  any 
point  in  time.  Factors  influencing  availability  include  the  manning,  oper¬ 
ations,  maintenance,  and  logistic  support  parameters. 

•  Dependability 

A  measure  of  the  system  condition  at  one  or  more  points  during  the  mission; 
given  the  system  conditions)  at  the  start  of  the  mission,  and  may  be  stated 
as  the  probability  that  the  system  will  enter  and/ or  occupy  any  one  of  its 
significant  states  during  a  specific  mission.  Factors  influencing  dependa¬ 
bility  include  the  system  parameters  of  reliability,  ground  survivability, 
and  in -mission  repairability  and  maintainability. 

•  Capability 

A  measure  of  the  ability  of  a  system  to  achieve  the  mission  objectives;  given 
the  system  conditions)  during  the  mission,  and  specifically  accounts  for  the 
performance  spectrum  of  a  system.  Factors  influencing  capability  include 
functional  performance  parameters,  enemy  threats,  vulnerability,  penetra¬ 
bility,  human  performance,  and  safety/ security  parameters. 
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TABLE  2-2  EXAMPLES  OF  MULTIMISSION  AIR  FORCE  SYSTEMS 


Multimisaion  System 

Mission 

Interceptor  Aircraft 

Enemy  Bomber  Interception,  Crew  Training, 

Combat  Engagement,  Ferrying 

Strategic  Bomber 

Enemy  Target  Destruction,  Airborne  Alert,  Crew 
Training,  Ferrying 

Tactical  Aircraft 

Reconnaissance,  Close  Air  Support,  Tactical 
Bombing,  Combat  Engagement,  Ferrying, 

Loitering 

Transport  Aircraft 

Emergency  Deployment,  General  Transfer  of 

Cargo,  Ferrying 

Communications  Satellite 

Transmission  of  Priority  Messages,  Transmission 
of  General  Messages 

Reconnaissance  Satellite 

Area  Surveillance,  Point  Surveillance 

Command  and  Control 

Air  Traffic  Control,  Interceptor  Vectoring,  Strike 
Planning 
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The  basic  system  effectiveness  framework  is  not  to  be  interpreted  as  restrictive. 

For  a  particular  application  it  may  be  desirable  or  practical  to  combine  the  availa¬ 
bility  and  dependability  parameters,  such  as  might  be  considered  for  a  set  of  mission 
assignments  recurring  in  different  sequences.  For  other  applications,  it  might  be 
appropriate  to  stratify  the  system  effectiveness  measure  into  effectiveness  param¬ 
eter  sets  other  than  availability,  dependability,  mid  capability,  as  long  as  subse¬ 
quent  compositing  of  the  sets  will  yield  the  defined  Figures  of  Merit. 

Figures  of  Merit  can  be  established  for  different  system  levels,  including: 

•  top-level  (e.  g. ,  a  force  structure  composed  of  systems  from  different  sys¬ 
tem  classes,  such  as  an  aircraft  system,  a  missile  system,  a  command- 
control  system,  and  a  support  system) 

•  first -level  (e.g. ,  a  strategic  aircraft  system  consisting  of  a  strategic  air¬ 
craft  and  an  air-to-ground  missile  system  carried  by  the  aircraft) 

•  second-level  (e.  g. ,  an  air-to-ground  missile  system) 

•  third-level  (e.  g. ,  an  avionics  subsystem  of  a  strategic  aircraft) 

Many  development  programs  involve  the  improvement  of  a  constituent  system  of  an 
overall  weapon,  support,  or  electronic  system.  For  such  situations,  second -level 
Figures  of  Merit  can  be  established  for  the  system  being  improved,  as  long  as  its 
assigned  mission  roles  are  defined  (even  in  the  absence  of  higher-order  integrating 
Figures  of  Merit  for  the  first-level  and  top-level  systems). 


Chapter  3 

SYSTEM  AND  COST  EFFECTIVENESS  IMPLEMENTATION 
FOR  CONCEPT  FOR  MU  LATION .  PHASE 


Summary 

The  principal  system  and  cost  effectiveness  criteria  formulation  and  evaluation 
elements  of  the  management  implementation  process  which  can  be  efficiently  and 
meaningfully  accomplished  during  Concept  Formulation  for  all  major  classes  of  Air 
Force  system  are  described  in  detail.  Hie  effectiveness  elements  are  defined  and 
related  in  terms  of  eight  step-by-step  implementation  activities.  These  are  (1) 
mission  analysis,  (2)  specifying  preliminary  Figures  of  Merit,  (3)  performance  re¬ 
quirements  analysis,  (4). operational  requirements  analysis,  (5)  effectiveness  para¬ 
meter  selection,  (6)  model  structuring,  (7)  system  and  cost  effectiveness  analysis, 
and  (8)  report.  The  technical  nature,  purpose,  and  application  aspects  of  each 
activity  are  presented.  Additionally,  practical,  simple,  and  versatile  techniques  and 
methods  are  outlined  for  each  activity.  These  techniques  and  methods  have  general 
applicability  to  all  classes  of  Air  Force  systems  and  are  responsive  to  the  gross-type 
of  information  normally  available  to  conduct  the  Concept  Formulation  studies  and 
analyses.  Specific  procedural  implementation  guidelines  also  are  presented  and  sum¬ 
marized  foi*  each  activity  of  the  effectiveness  process.  Further,  the  information 
needed  to  implement  each  activity,  and  the  technical  uses  of  the  activity  outputs  are 
polarized  with  respect  to  other  contributing  and  recipient  activities  of  the  effectiveness 
process  and  the  interfacing  system  program  management  (AFSCM  375-4)  and  systems 
engineering  management  (AFSCM  375-5)  processes. 
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3-1  GENERAL 


The  Concept  Formulation  Phase  of  system  development  projects  Is  the  responsibility 
of  HQ  USAF.  The  purpose  of  this  phase  is  to  provide  the  technical,  economic,  and 
military  justification  and  bases  for  proceeding  with  the  subsequent  phases  of  Con¬ 
tract  Definition  and  Engineering  Development.  The  primary  results  of  the  Concept  J 
Formulation  Phase  are  documented  in  a  Concept  Formulation  Package/Tecbnical 
Development  Plan  (CFP/TDP).  Department  of  the  Air  Force  Regulation,  AFR  80-20, 
requires  that  conditional  approval  for  proceeding  with  engineering  development  be 
based  on  Concept  Formulation  Phase  results  that  have  met  the  following  six  pre¬ 
requisites: 

(1)  The  effort  required  is  primarily  engineering  rather  than  experimental,  and 
the  technology  needed  is  sufficiently  in  hand. 

(2)  The  mission  and  performance  envelopes  are  defined. 

(3)  The  best  technical  approaches  have  been  selected. 

(4)  A  thorough  trade-off  analysis  has  been  made. 

(5)  The  cost  effectiveness  of  the  proposed  item  has  been  determined  to  be  favorable 
in  relationship  to  the  cost  effectiveness  of  competing  items  on  a  DOD-wide  basis. 

(6)  Cost  and  schedule  estimates  are  credible  and  acceptable. 

The  early  implementation  of  the  system  and  cost  effectiveness  management  process 
during  this  phase  will  contribute  to  the  achievement  of  all  of  the  six  prerequisites  by 
providing  an  objective  and  integrated  evaluation  of  the  potentials  of  proposed  system 
concepts  to  meet  military  objectives  as  defined  in  documents  such  as  the  Required 
Operational  Capability  (ROC)  and  Requirements  Action  Directive  (RAD). 

The  following  implementation  steps  summarize  in  general  the  effectiveness  activities 
required  during  Concept  Formulation: 

a  Istep  El  -  Mission  AnalysiTj  This  activity  addresses  the  an'^ysis  of  mis¬ 
sion  requirements  to  define  them  in  terms  of  quantifiable,  specific  objectives 
and  operational  conditions. 
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•  (step  E2  -  Specifying  Preliminary  Figures  of  Merit!  This  activity 
provides  a  technical  comparison  and  evaluation  basis  for  selection  of 
the  system  concept  with  the  optimum  balance  of  technical  system  per¬ 
formance  effectiveness. 

•  {Step  E3  -  Performance  Requirements  Analysis']  This  activity  addresses 
the  technical  translation  of  mission  requirements  and  conditions  and  the 
preliminary  Figures  of  Merit  into  gross  system  functions  and  performance 
parameters  influencing  system  effectiveness. 

•  {Step  E4  -  Operational  Requirements  Analysis!  This  activity  addresses 
the  technical  translation  of  mission  operational  requirements  to  gross 
system  manning,  operations,  maintenance,  and  logistic  support  require¬ 
ments. 

•  |Step  E5  -  Effectiveness  Parameter  Selection]  This  activity  identifies  the 
gross  top-level  system  performance  parameters  and  accountable  factors 
critical  to  a  preliminary  FOM  and  its  effectiveness  parameters  of  avail¬ 
ability,  dependability,  and  capability,  and  establishes  their  cause-and-effect 
relationships  and  sensitivities. 

•  fstep  E6  -  Model  Structuring*)  This  activity  provides  the  overall  mathemat¬ 
ical  and/or  simulation  models  for  use  in  numerical  effectiveness  analysis  of 
the  interactive  and  integral  cause-and-effect  relationships  of  accountable 
factors,  system  parameters,  effectiveness  parameters,  and  Figures  of 
Merit  for  each  feasible  system  approach. 

t  (step  E7  -  Fystemand  Cost  Effectiveness  Analysis)  This  activity  provides 
for  the  analysis  and  evaluation  of  each  feasible  system  approach  for  an 
optimum  balance  of  performance  and  cost.  Additionally,  the  activity  pro¬ 
vides  for  each  competing  system  approach  current  and  projected  Figure  of 
Merit  estimates  to  be  used  as  comparative  selection  criteria  for  management 
decisions,  leading  to  the  system  description  with  optimum  effectiveness. 
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•  Lltep  E8  -iReport]  This  activity  provides  the  Air  Force  technical  activity 
with  a  compendium  of  the  effectiveness  criteria  formulation  and  evaluation 
results  to  support  program  decisions  and  for  inclusion  in  the  RAD  revision 
and  CFP/TDF  document  to  be  issued  at  the  end  of  the  Conceptual  Transition 
Phase  of  Concept  Formulation. 


3-2  MISSION  ANALYSIS  jSTEP  Eli 
General 

The  initial  step  of  the  effectiveness  criteria  formulation  and  evaluation  process  is  the 
mission  analysis.  This  involves  the  preparation  of  a  description  which  generally  and 
specifically  defines  the  mission  objectives  and  operational  conditions  anticipated  to  in¬ 
fluence  the  successful  accomplishment  of  the  mission. 

Procedure 

The  description  of  the  mission  is  to  include  both  general  and  specific  mission  objectives. 
The  general  objectives  are  intended  as  a  gross  summary  of  the  functions  and  purposes  of 
the  mission.  The  specific  objectives  are  to  further  define  the  general  objectives  of  the 
mission,  and  are  to  be  meaningfully  stated  in  unequivocal  and  measurable  terms. 

Specific  objectives  should  have  the  following  descriptive  characteristics: 

•  They  communicate  the  mission  intent .  The  best  stated  objectives  are  ones 
which  minimize  alternate  interpretations  of  the  specific  mission  goals. 

•  They  describe  the  specific,  measurable  and  observable  terminal  behavior 
required  of  a  system  which  is  acceptable  as  evidence  that  the  system  can 
achieve  the  mission  objectives. 

•  They  are  mutually  exclusive  in  that  one  specific  objective  does  not  encom¬ 
pass  any  other  objectives  in  part  or  in  whole.  This  allows  for  trade-off 
decisions  on  independent  objectives  and  eliminates  possible  double  counting 
(in  the  effectiveness  sense). 


•  They  refer  to  mission  performance  goals  of  the  highest  degree  of 
importance,  thereby  providing  a  common  frame  of  reference  for  (1)  the 
establishment  of  top-level  and  first- level  system  performance  criteria, 
and  (2)  the  formulation  of  unambiguous  effectiveness  measures. 

The  set  of  specific  mission  objectives  provides  the  focal  point  for  the  establishment 

t 

of  system-level  functions,  the  determination  of  system  performance  parameters  re¬ 
quired  for  these  functions,  and  the  formulation  of  system  and  cost  effectiveness 
measures  to  be  accomplished  in  a  later  step  of  the  effectiveness  process. 

The  operational  conditions  under  which  the  mission  is  to  be  performed  is  a  necessary 
part  of  an  overall  identification  of  mission  objectives.  General  and  quantitative  de¬ 
scriptions  are  required  of  the  mission  conditions  expected  to  significantly  influence 
system  performance,  including: 

•  The  kinds,  magnitude,  and  probability  of  enemy  threats  and  enemy  counter¬ 
measures  expected  to  be  present  as  of  a  specific  current  date  and  five  years 
in  the  future  for  the  wartime  mission. 

•  The  system  survival  requirements  under  battle  and  peacetime  operational 
levels  of  shock,  temperature,  radiation,  and  similar  natural  environments. 

During  Concept  Formulation,  specific  requirements  associated  with  the  mission  objec¬ 
tives  and  conditions  are  progressively  refined,  especially  the  quantitative  level  of  mis¬ 
sion  conditions  expected  and  the  terminal  performance  behavior  required  of  a  system. 
Where  necessary,  these  requirements  must  be  postulated  at  the  onset  before  any  effec¬ 
tiveness  analysis  is  to  be  conducted.  Otherwise,  unrealistic  and  ambiguous  results 
will  be  obtained  and  will  invalidate  system  selection  decisions,  since  the  analysis  would 
be  based  on  unspecific,  indefinite  objectives  and  conditions  which  are  subject  to  inter¬ 
pretation. 

Information  Flow 

Normally,  the  ROC  document  will  provide  the  basic  information  for  the  mission  analysis 
activity  of  the  effectiveness  formulation  and  evaluation  process.  The  ROC  .vili  contain 
general  mission  objectives  and  conditions,  as  well  as  any  specific  objectives  and  con¬ 
ditions  that  may  have  been  confirmed.  Additional  mission  analysis  inputs  are  the  related 
technical  reports  of  system  studies  which  may  have  been  issued  previously  by  AFSC  and 
using  commands.  , 
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The  mission  analysis  activity  provides  the  basio  inputs  to  the  performance  requirements 
analysis,  the  next  effectiveness  criteria  formulation  activity.  Results  of  the  mission 
analysis  are  to  be  progressively  updated  during  the  Concept  Formulation  Phase  for  in¬ 
clusion  in  the  CFP/TDP  and  updated  RAD  to  be  prepared  at  the  conclusion  of  the  phase. 
Coordination,  therefore,  is  required  between  the  AFSC  and  the  using  commands  to  more 
specifically  define  the  mission  objectives  and  the  conditions  for  inclusion  in  the  RAD. 

The  basic  information  network  for  the  mission  analysis  activity  is  shown  in  Figure  3-1. 


3-3  SPECIFYING  PRELIMINARY  FIGURES  OF  MERIT  jSTEP  E2l 
General 

The  mission  analysis  defines  the  mission  in  terms  of  specific  objectives  and  operational 
conditions.  The  general  measure  of  the  extent  to  which  a  system  may  be  expected  to 
achieve  this  set  of  performance  objectives  is  a  function  of  the  effectiveness  parameters 
of  availability,  dependability,  and  capability,  and  is  designated  as  system  effectiveness, 
with  the  measure  of  system  effectiveness  pertaining  to  ore  or  more  of  the  mission  objec¬ 
tives  during  this  phase  defined  as  a  preliminary  Figure  of  Merit  (FOM). 

Previous  conceptual  studies  of  military  doctrines,  resource  availability,  and  technical 
feasibility  of  various  operational  and  system  concepts  to  accomplish  the  overall  mission 
are  relevant  to  the  formulation  of  the  preliminary  FOM.  Through  broad  trade-studies 
and  use  of  operations  research  techniques,  choices  of  systems  or  system  combinations 
have  been  narrowed  to  a  few  promising  concepts  potentially  possessing  the  needed  basic 
capabilities.  To  a  large  extent,  such  information  is  reflected  in  the  ROC  and  its  sup¬ 
portive  studies  and,  along  with  the  mission  analysis  results,  is  the  minimum  required 
to  formulate  a  preliminary  effectiveness  measure  to  be  used  as  a  technical  and  evalu¬ 
ation  benchmark  during  the  Concept  Formulation  Phase . 

Typically,  an  effectiveness  measure  will  be  broad  at  this  point  in  time  since  numerical 
values  may  not  be  definable  because  of  the  general  nature  of  studies  to  date.  Consistent 
with  the  definition  of  mission  objectives,  however,  it  is  important  that  the  effectiveness 
measure  also  be  stated  in  terms  of  performance  behavior  which  is  observable  and 
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measurable  in  the  candidate  systems.  An  effectiveness  measure  relates  to  the  net  worth 
or  merit  of  a  system  to  accomplish  its  assigned  mission  objectives.  As  such,  it  is  not 
fully  independent  of  the  system  configuration,  although  in  principle  it  is  independent  in 
that  it  is  a  reflection  of  the  mission  objectives  and,  therefore,  should  not  be  tailored 
to  fit  a  specific  system  configuration  or  make-up  which  could  compromise  the  mission 
objectives.  As  the  candidate  system  concepts  with  the  greatest  likelihood  of  meeting 
the  mission  objectives  become  more  fully  defined,  however,  a  refinement  of  the  pre¬ 
liminary  effectiveness  measure  is  required  to  reflect  numerical  objectives  and  the 
lat^Sk  mission  requirements  for  inclusion  in  the  RAD. 

The  basic  purposes  of  defining  a  preliminary  system  effectiveness  measure  early  in 
Concept  Formulation  are: 

(1)  To  provide  a  common  criterion  of  competence  based  on  an  objective,  per- 
performance-oriented  measure  of  a  system's  overall  worth  in  meeting  mis¬ 
sion  objectives  for  the  initial  and  critical  decision  of  system  concept  selection. 

(2)  To  ensure  a  focal  performance  objective  for  the  continuum  of  system  program, 
systems  engineering,  and  other  disciplinary  actions  directed  at  establishing 
system  requirements  and  more  detail  concepts. 

(3)  To  provide  a  common  benchmark  for  continuing  effectiveness  decisions  and 
evaluations  by  Government  and  cortrcotor  personnel. 

A  system's  overall  role  in  a  mission  is  the  principal  criterion  for  the  development  of 
realistic  and  useful  preliminary  FOMs.  A  system  may  be  usable  for  different  types  of 
missions.  Such  a  system  will  have  multiple  FOMs  associated  with  it,  one  for  each  type 
of  mission  that  the  system  is  capable  of  executing.  Due  to  operational  considerations 
such  as  tactics  and  countermeasures,  a  system  also  may  have  the  capability  f  r  employ¬ 
ment  'a  different  ways  to  accomplish  objectives  relating  to  the  same  type  of  mission.  For 
such  systems,  an  additional  preliminary  FOM  should  be  ascribed  to  each  significantly  dif¬ 
ferent  way  for  which  a  particular  type  of  mission  can  be  executed.  Where  a  large  number 
of  ways  are  involved,  a  composite  FOM  addressing  the  system's  adequacy  to  accomplish 
the  spectrum  of  ways  may  be  the  most  practical  measure  to  use.  The  use  of  a  composite 
FOM  measure  also  may  be  equally  appropriate  for  the  ana’  ous  situation  where  a  1  mg1., 
or  continuous  range  of  mission  outcomes  is  present  for  any  single  v  „y  that  a  particular 
tyoe  of  mission  can  be  accomplished 
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Iii  general,  :i  'liminury  FOM  statement  .should  be  based  on  probability  concepts,  with 
:i  mini  mum,  n  ;inuim,  or  expected  value  assigned  depending  on  the  extent  of  system  and 
mission  deli  don  achieved  and  the  specific  mission  needs.  Further,  weighted  mathe¬ 
matical  combinations  of  FOMs  associated  with  different  missions  to  arrive  at  a  composite, 
overall  FOM  lor  the  totality  of  missions  should  be  used  only  under  restrictive  conditions 
wherein  <  1 )  a  relative  importance  can  be  validly  assigned  to  each  mission,  (2)  the  FOMs 
to  be  combined  arc  of  the  same  measurement  unit,  and  (3)  the  resultant,  single  FOM 
does  not  create  an  artificial  technical  and  military  use  situation. 

The  primary  utility  of  the  preliminary  FOM  (or  FOMs)  to  be  established  in  the  Concept 
Formulation  Phase  is  to  provide  a  technical  comparison  and  evaluation  base  for  con¬ 
ceptual  studies.  For  some  applications,  a  subset  of  specific  objectives  or  unique  capa¬ 
bilities  required  for  improving  military  force  effectiveness  could  be  emphasized.  For 
use  in  this  context,  the  preliminary  FOM  may  not  necessarily  correspond  to  the  principal 
FOM  to  be  developed  during  Contract  Definition,  nor  be  structured  as  an  encompassing, 
integrated  measure  of  the  system’s  net  worth  to  the  mission. 

Procedure 

The  procedure  for  establishing  a  preliminary  FOM  involves  the  following  technical 
activities: 

•  Identify  from  the  mission  objectives  the  basic  capabilities  that  the  system  is 
to  possess  and  which  are  to  be  used  as  a  technical  and  comparison  base  for 
concept  selection  decisions 

•  Translate  the  mission  objectives  into  quantifiable,  compositing  measures  of 
system  performance  which  are  observable 

m  Identify  the  kinds  and  levels  of  mission  conditions  which  are  to  apply,  assigning 
minimum,  maximum  and/or  average  values  as  appropriate 

•  Prepare  a  description  of  the  preliminary  FOM  for  inclusion  in  the  RAD,  Ex¬ 
amples  of  FOMs  are  listed  in  Table  3-1. 


Information  Flow 

I  hc  primary  inputs  for  preparing  the  descriptive  statement  of  the  preliminary  FOMs 
are  ’he  result  of  (he  mission  analysis.  Figure  3-2  shows  the  information  network  for 
the  specifying  preliminary  Figures  of  Merit  activity  of  the  effectiveness  process. 


TABLE  3-1  FIGURE  OF  MERIT  EXAMPLES 


System  Class 

Mission 

Figure  of  Merit 

• 

Interceptor 

The  interceptor  squadron  is  to 

la) 

Probability  of  destroying  bp 

identify  and/or  dest  roy  assigned 
target  aircraft;  the  prime  mission 

enemy  aircraft  per  engagement 

is  to  be  supported  with  necessary 

lb) 

Expected  targets  killed  per  da v 

training  missions 

by  a  fixed  force 

IC) 

Exj>eclod  number  of  training 
missions  which  can  be  com¬ 
pleted  per  month 

• 

Strategic 

The  strategic  bom  lie  r  is  to  de- 

la) 

Probability  of  destroying  'm 

Bomber 

liver  its  payload  to  an  assigned 
target  within  prescribed  accur- 

targets 

icy  and  then  return  to  base;  the 

(b) 

Probability  of  <n)  bombs  on 

prime  mission  is  to  be  supported 

target  per  aircraft 

with  necessary  training  missions 

(c) 

Expected  number  of  training 
missions  which  can  be  com¬ 
pleted  per  month 

• 

Tactical 

The  tactical  aircraft  is  to  (1) 

(a) 

Expected  number  of  sorties 

Aircraft 

provide  close  air  support  for 

which  can  be  accomplished 

ground  troops,  (2)  bomb  tactical 

per  month 

targets,  (3)  fly  reconnaissance, 
and  <4)  provide  air  escort  for 

lb) 

Probability  of  successfully 

tactical  bombers. 

completing  a  close  air  supjjort 

(c)  Probability  of  successfully 
completing  a  tactical  bombing 
mission 


(d)  Probability  of  successfully 
completing'  a  reconnaissance 
mission 

i.o!  Probability  of  successfully 
completing  an  air  escort 
mission 


•  Transport 


The  transport  aircraft  is  to  Cl/ 
deliver  a  strategic  cargo  from 
origin  to  destination  within  a 
prescribed  time,  and  (2)  trans¬ 
port  general  cargo 


fa)  Probability  of  delivering  a 

specified  strategic  cargo  to  its 
destination  iton-milest  within 
lx)  hours 
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System  Class 


Mission 


Figure  of  Merit 


•  Transport 
(Continued) 


•  Space  Launch 
Vehicle 


(b)  Expected  time  required  to 
deliver  strategic  cargo 

(c)  Expected  number  of  ton-miles 
of  general  cargo  transported 
per  sortie 

(d)  Probability  of  take-off  and  land¬ 
ing  in  (x)  distance  with  a  speci- 

_ fied  gross  weight _ 

The  launch  vehicle  is  to  place  (a)  Probability  of  placing  the  pay- 
a  given  payload  into  a  pre-  load  into  orbit 

scribed  orbit  within  a  specified 
time  interval 


•  Communications 
Satellite 


The  communications  satellite  is 
to  (1)  transmit  high  priority 
messages  within  a  specified  time, 
and  12)  transmit  low  priority 
during  slack  time 


(a)  Probability  of  transmitting  a 
high  priority  message  within 
(x)  seconds 

(b)  Expected  number  of  low  priority 
messages  transmitted  per  month 


(c)  Expected  waiting  time  of  a  low 
priority  message 

(d)  Expected  number  of  channels 
operating  at  a  specified  effec¬ 
tive  radiated  power  over  (n)  years 

(e)  Probability  that  the  ground  system 
will  operate  continuously  for  (x) 
period  of  time  find 

11)  locate  an  orbiting'  satellite  at 
a  given  point  in  time, 

(2)  transmit  commands  to,  and 
receive  data  from  the  satellite, 

(3)  spatially  correlate  the  data 
when  required,  and 

(4)  control  and  operate  the  payload 


TABLE  3-1  FIGURE  OF  MERIT  EXAMPLES  (Continued) 


System  Class 


Mission 


Figure  of  Merit 


•  Intercontinental 
Ballistic 
Missile 


The  ground-to-ground  ballistic 
missiles  are  to  destroy  pre¬ 
scribed  enemy  targets,  given 
a  prescribed  sequence  of  mis¬ 
siles  initiated  at  random  times 


Probability  of  destroying  a 
prescribed  target  of  (x>  hard¬ 
ness  when  (n)  missiles  are 
targeted  on  it 


(b)  Expected  number  of  targets 
destroyed  of  (x)  hardness 
with  (n)  or  less  missiles 


(c)  Probability  that  the  mis¬ 
sile  can  be  stored  in  the  silo 
with  all  circuits  energized 
for  (x)  years  and  no  main- 


(d)  Probability  that  a  missile 
can  respond  to.  and  meet, 
a  specific  mission  directive 
at  a  random  point  in  tune 
following  ar.  alarm  condition 
shall  be  greater  than  (y) 

•  Air  Interceptor  The  air-to-air  missile  is  to  ties-  (a)  Probability  oi  destroying  an 

Missile  troy  enemy  aircraft  when  enemy  aircraft  with  (n)  or  less 

launched  on  a  prescribed  pur-  missiles 

suit  path 

(b)  Expected  number  of  missiles 
required  per  squadron  to  main- 
fain  an  (x)  level  of  operational 
readiness 


•  Air-to-Ground  The  air-to-ground  missile  is  to  (a)  Probability  of  destroying  ar  ix) 

Missile  destroy  prescribed  targets  hardened  target  with  (n)  or  less 

missiles 

(in  Expected  level  of  damage  to  an 
a)  hardened  target  with  (n)  or 
, ess  missiles 

a )  Probability  of  destroying  in)  of 
'm)  targets  assigned  to  the 
squadron 

id)  Expected  number  of  missiles 
per  squadron  required  to  main¬ 
tain  an  ex)  level  of  operational 
readiness 


TABLE  3-1  FIGURE  OF  MERIT  EXAMPLES  (Continued) 


System  Class 

Mission 

Figure  of  Merit 

•  Command 

The  command  and  control  system 

(a) 

Expected  information  re- 

and 

is  to  (1)  store,  process,  and  re- 

trieval  time 

Control 

trieve  information  for  command 
decision,  (2)  control  traffic  of 

(b) 

Probability  of  information 

friendly  aircraft,  (3)  detect  and 
track  enemy  aircraft,  and  (4) 

loss 

vector  interceptors  engaging 

(o) 

Probability  of  controlling 

enemy  aircraft 

traffic  up  to  (n)  friendly  air¬ 
craft  given  no  enemy  aircraft 
are  being  engaged 

l 

(d ) 

Probability  of  successfully 
vectoring  intercepts  against 
(n)  enemy  aircraft 

•  Warning 

The  warning  and  detection  sys- 

(a) 

Probability  of  detecting  an 

tem  is  to  detect  and  track  an 

object  given  that  <n)  tracks 

Detection 

airborne  or  sea-launched  ob¬ 
ject  within  a  prescribed  ac- 

are  in  process 

curacy  and  a  prescribed  cover- 

(b) 

Probability  of  successfully 

age  area 

completing  a  track,  given 
detection 

<e) 

Expected  number  of  tracks 
which  can  be  performed 
simultaneously  within  a 
prescribed  accuracy 

3-4  PERFORMANCE  REQUIREMENTS  ANALYSIS  |  STEP  E3| 


General 

The  purpose  of  the  performance  requirements  analysis  is  to  translate  the  mission 
objectives  and  conditions  into  gross  system  functions  and  system  performance  param¬ 
eter  requirements  critical  to  the  preliminary  FOM  and,  thus,  the  effectiveness  of  the 
system.  The  analysis  is  best  accomplished  by  the  preparation  of  a  performance  require¬ 
ments  profile.  This  profile  is  a  practical  method  for  compositing  and  analyzing  the 
mission-system  relationships  influencing  mission  accomplishment  and  system  effectiveness. 

A  performance  requirements  profile  is  time-phased.  It  usually  consists  of  a  set  of  tables 
and  matrices  that  collectively  provide  an  analytical  compendium  of  the  quantitative  system 
performance  parameters.  The  primary  uses  of  the  profile  during  Concept  Formulation  are: 

e  To  establish  the  basic  reference  frame  for  establishing  a  more  specific, 

analytical  description  of  the  preliminary  FOMs,  and  for  the  subsequent  analysis 
of  a  system's  ability  to  meet  the  FOMs. 

•  To  document  initial  effectiveness  decisions  for  later  retrieval,  and  to  reveal 
where  future  decisions  are  required. 

•  To  identify  the  set  of  relevant  system  performance  parameters  influencing 
effectiveness  for  trade-off  studies  and  decisions. 

•  To  provide  visibility  of  the  system  performance  parameter  values  which  are 
unknown,  grossly  known,  or  more  precisely  known,  and,  thus,  ensure  validation 
of  the  credibility  to  be  attached  to  later  effectiveness  evaluation  results. 

Separate  resolution  of  each  mission  is  required  for  multi-mission  systems.  Also,  where 
a  system  is  intended  for  multi-mode  usage,  such  as  primary,  secondary,  back-up,  etc., 
or  where  different  combinations  of  system  functions  will  be  utilized,  each  mode  and  func¬ 
tion  combination  must  be  separately  portrayed  and  analyzed. 
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Relationships  of  mission  objectives  to  system  performance  requirements  to  be 
quantitatively  analysed  with  a  performance  requirements  profile  include  the 
following: 

•  Mission  objectives  to  mission  performance  requirements. 

•  Mission  performance  requirements  to  overall  gross  system  functions. 

•  Overall  gross  system  functions  to  gross  system  performance  param¬ 
eters,  including  functional/physical  parameters  and  specialty  technical 
parameters  of  reliability,  maintainability  during  mission,  survivability, 
safety,  human  factors,  etc. 

•  System  counter  threat  or  neutralizing  capabilities  for  the  kinds  and  levels 
of  mission  conditions  expected. 

During  Concept  Formulation,  the  profile  is  to  be  grossly  portrayed  at  the  top-level  in  a 
simplified  form,  and  is  to  be  extended  to  the  first  level  of  design  if  details  permit.  A 
further  extension  to  the  second  level  is  not  required.  In  the  development  of  the  profile, 
it  is  desirable  to  quantitatively  define  as  many  of  the  relationships  as  possible.  Those 
relationships  for  which  values  cannot  be  practically  assigned  at  this  point  must  be  handled 
qualitatively,  but  should  be  kept  to  a  minimum. 

Procedure 

The  following  steps  are  necessary  to  a  performance  requirements  analysis: 

•  Identification  of  mission  performance  requirements  and  the  specific  kinds 
and  levels  of  conditions  surrounding  the  mission,  including  their  probability 
of  occurring 

•  Identification  of  overall  system  functions  required  for  each  candidate  system 
concept  to  realize  the  mission  performance  requirements 

•  Identification  of  top-level  system  design,  performance  parameters  and  constraints 
imposed  on  those  parameters  by  the  mission  requirements,  mission  conditions, 
and  system  functions 


VlC 
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•  Identification  of  the  maintenance  concepts  applicable  to  a  mission 
assignment,  including  capability  requirements  for  correction  of  malfunctions, 
over-ride,  and  correction  of  battle  damage  through  permanent  or  temporary 
repairs  (e.g. ,  in-flight  or  ground  controlled  adjustments) 

•  Preparation  of  matrices  and/or  tables  of  the  relationships.  Table  3-2 
presents  a  typical  listing  of  mission  requirements,  mission  conditions,  and 
system  performance  functions  and  parameters  for  inclusion  in  a  performance 
requirements  analysis.  The  listing  addresses  all  classes  of  Air  Force 
systems  and  a  typical  information  availability  situation.  Therefore,  all  of 
the  listed  requirements,  conditions,  functions,  and  parameters  will  not 
necessarily  apply  to  any  one  system  or  system  class. 

Information  Flow 

The  basic  input  data  required  for  the  performance  requirements  analysis  are: 

•  Mission  objectives  .requirements,  and  conditions,  and  their  values,  from  the 

>■  mission  analysis  activity  and  the  RAD, 

•  The  preliminary  FOMs,  die  related  objectives  represented  by  the  FOMs, 
and  the  rationale  for  FOM  selection  from  the  RAD  and/or  from  the  effective¬ 
ness  activity  of  specifying  preliminary  Figures  of  Merit. 

•  The  time -sequenced,  proposed  system  functions,  the  Requirements  Allocation 
Sheets,  Trade  Studies,  and  Time  Lines  from  the  Develop  Gross  Functions 
activity  of  the  systems  engineering  management  process  defined  in 

AFSCM  375-5. 

•  The  initial  top-level  system  design/performance  requirements  and  their 
values,  from  the  Determine  Design  Requirements  activity  of  the  systems 
engineering  management  process,  also  defined  in  AFSCM  375-5, 

The  results  of  the  performance  requirements  analysis  will  be  used  to  establish  the 
top-level  system  performance  parameters  for  each  system  that  are  critical  to  the 


1  f 
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TABLE  3-2  TYPICAL  MISSION  REQUIREMENTS,  MISSION  CONDITIONS,  SYSTEM 
FUNCTIONS,  AND  SYSTEM  PERFORMANCE  PARAMETERS 


Mission  Requirements 

•  Destination  and  path 

9  Accuracy 

•  Payload 

•  Envelope 

•  Range 

•  Kill  probability 

•  Coverage 

•  Life 

•  Rate 

•  Weight  and  size 

•  System  effectiveness 

•  Safety/Security 

•  Communications 

•  Training 

Mission  Conditions 

•  Enemy  threats  and  counter¬ 

measures 

•  Natural 

environments 

•  Reaction  time 

System  Functions 

•  Control  and  stabilization 

•  Propulsion 

•  Communications 

•  Command 

•  Detection  and  identification 

•  Acquisition 

•  Track 

9  Cruise 

•  Climb 

•  Payload  delivery 

•  Combat 

•  Navigation 

•  Data  processm- 

•  Terrain  avoidance 

•  Land 

•  Intercept 

«  Engage 

•  Recornaissanee 

•  Ferry 


System  Performance  Parameters 

9  Trajectory 

•  Weight 

•  Accuracy 

#  Envelope 

9  Information  rate 

9  Payload  dynamics 

9  Range 

t  Take-off  and  landing  distances 

9  Refueling  characteristics 

9  Speed 

9  Thrust 

9  Weapon  capacity 

9  Maintainability  during  mission 

9  Reliability 

9  Survivability 

t  Vulnerability 

9  Penetrability 

9  Safety 

9  Power 

#  Rates 

9  Noise 

9  Human  performance 

9  Lethality 

t  Stability 
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preliminary  FOMs.  Upon  an  integrated  analysis  of  the  top-level  system  design/ 
performance  requirements  later  in  the  effectiveness  process,  the  best  combination 
of  parameter  values  for  a  maximum  effectiveness  can  be  determined.  These  values 
then  can  be  used  to  confirm  or  update  the  initial  values  for  inclusion  in  the  CFP/TDP , 

Figure  3-3  illustrates  the  basic  information  network  for  the  performance  requirements 
analysis. 


3-5  OPERATIONAL  REQUIREMENTS  ANALYSIS  |  Step  E4 1 
General 

The  technical  concepts  and  parameters  for  manning,  operating,  maintaining,  and 
logistically  supporting  a  weapon, electronic,  or  support  system  have  a  major  influence 
on  the  effectiveness  of  the  system  to  respond  to  mission  directives  and  to  accomplish 
mission  assignments  of  the  Air  Force  (TAC,  ADC,  SAC,  AFLC,  etc.).  These  con¬ 
cepts  and  parameters  are  the  basis  by  which  the  using  commands  can  plan  tactics, 
readiness  exercises,  and  training  to  fully  utilize  the  capabilities  of  the  system. 

Mission  requirements  and  system  performance  parameters  have  been  defined  by  the 
performance  requirements  activity  of  the  previous  step  in  the  effectiveness  process . 
These  parameters  are  normally  associated  with  the  effectiveness  parameter  sets  of 
dependability  and  capability.  To  complete  the  definition  of  the  parameter  sets  which 
can  influence  the  effectiveness  of  a  mission,  another  set  of  performance  parameter? 
must  be  defined,  and  the  associated  mission-system  interrelationships  analyzed.  This 
set  consists  of  the  system  operational  parameters.  Consistant  with  the  performance 
requirements  analysis,  the  purpose  of  the  operational  requirements  analysis  is  to 
translate  the  mission  operational  requirements  into  needed  system  concepts  and  domi¬ 
nant  manning,  operations,  maintenance,  and  logistics  parameters  contributing  to  sys¬ 
tem  effectiveness. 

The  availability  parameter  of  system  effectiveness,  by  encompassing  the  manning, 
ground  operations,  maintenance,  and  logistics  characteristics  of  a  system,  is  a  meas¬ 
ure  of  the  readiness  or  condition  of  the  system  at  the  start  of  the  mission  at  any  point 


1 
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in  time .  For  recurring  type  missions  (e.g. ,  air  escort  missions,  tactical  air-to- 
ground  missions,  weapon  delivery  missions  of  a  squadroi.  of  tactical  aircraft, 
warning  and  detection  missions,  etc,),  the  effectiveness  parameter  of  availability' 
is  also  dependent  upon  the  mission  system  reliability  parameter  of  the  effectiveness 
dependability  parameter,  since  the  frequency  and  duration  of  needed  ground  main¬ 
tenance  and  repairs  will  be  influenced  by  the  kinds  and  magnitude  of  failures  and 
malfunctions  expected  to  occur  during  mission  assignments. 

An  integrated  approach  to  the  analysis  of  oj  j rational  parameters  is  required  to 
collectively  and  quantitatively  identify  and  define  the  principal  system  parameters 
contributing  to  availability,  and  hence  to  system  effectiveness.  This  is  a  technical 
necessity  because  of  the  interrelationships  among  the  operational  parameters.  The 
results  of  this  integrated  approach  will  provide  useful  design  guidelines  to  system 
developers  as  well  as  simplified  information  for  decision  making  by  both  logistics 
and  operational  planners  relative  to  obtaining  maximum  utilization  of  the  system  at 
minimum  operational  cost. 

System  operational  parameters  which  we  interrelated  and  provide  the  b?si«  for  per¬ 
formance,  time,  and  resource  trade-offs,  the  comparative  analysis  of  alternate  sys¬ 
tem  concepts,  and  the  evaluation  of  different  operational  policies,  include: 

9  Maintenance 

•  Employment 

•  Deployment 

■  Trrr.oportation 

•  Personnel 

9  Base  and  depot  support 

•  Training 

•  Test  and  activation 
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As  with  the  performance  requirements  analysis,  the  operational  requirements  analysis 
is  best  accomplished  by  the  preparation  of  a  profile,  with  the  basic  uses  of  the  profile 
being  identical  to  those  fur  the  performance  requii^  >iicm c*  promc . 

Procedure 

The  following  is  a  procedure  for  accomplishing  an  operational  requirements  analysis: 

•  Identification  of  the  operational  requirements  for  the  mission  in  terms  of 
specific,  quantifiable  objectives  and  constraints. 

•  Establishment  of  a  mission-level  measure  of  operational  performance 
which  can  be  commonly  used  for  all  candidate  systems  concepts.  The 
measure  is  to  reflect  the  operational  availability  of  the  system  for  a 
specific  mission  assignment,  and  is  to  account  for  the  integrated  contri¬ 
bution  to  the  total  operational  turnabout  and  react  .on  time  span  by  the 
system's  manning,  operations,  maintenance,  and  logistic  support  para¬ 
meters  and  assets.  Examples  of  availability  measures  are  listed  in 
Table  3-3. 

■  Definition  of  the  operational  concepts  associated  with  each  candidate  sys¬ 
tem  approach.  Examples  of  concepts  to  be  defined  also  are  listed  in 
Table  3-3. 

•  Gross  identification  of  the  requirements  for  system  operational  parameters 
such  as  maintainability,  reaction  time,  and  required  turnabout  time  in¬ 
fluencing  the  mission  operational  requirements,  and  constraints  that  the 
requirements  may  impose  on  these  parameters. 

•  Preparation  of  a  composite  display  of  the  interrelationships  in  the  form  of 
an  operational  requirement  profile.  For  the  parameters  where  gross  values 
cannot  be  established  at  this  point  in  the  Concept  Formulation  Phase,  the 
values  are  to  be  defined  later  In  the  effectiveness  process.  Examples  of 
operational  parameters  influencing  availability  also  are  Meted  in  Table  3-3. 
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TABLE 


3-3  EXAMPLE?  Ci'  OPERATIONAL  AVA1LABI 
MEASURES,  CONCEPTS,  AND  PARAMETERS 


Availability  Measure 

•  Operational  time  per  a  fixed  period  (e.  g. ,  available  flight  time  per  month) 

•  Probability  that  the  weapon  can  be  stored  with  all  circuits  energized  for 
(x)  years  and  no  maintenance 

•  In-commision  (ready)  rate  or  utilization  rate 

•  Probability  of  completing  turn-about  in  (t)  time  or  less 

•  Reaction  time 

Operational  Concept 

•  Basic  Maintenance  Policy 

•  Level  and  location  oi  maintenance 

•  Level  and  location  of  spares* 

©  Alert  conditions* 

<*»  Number  of  installations,  sites,  and  operating  locations* 

Operational  Parameter 

Maintenance  Parameter 

■  Mean  and  maximum  time  to  repair* 

•  Mean  and  maximum  time  to  restore  for  continuous  operation 

•  Maintenance  man-hours  per  operating  hours* 

•  Time  constraints  for  preventive  maintenance* 

•  Maintenance  environment,  including  facilities,  climate,  and  geo¬ 
graphical  location 

•  Probability  of  maintenance  (probability  that  maintenance  will  be  completed 
in  (t)  time  or  less) 

•  Type  and  level  of  personnel  required,  by  specialty  skills* 

•  First-level  spares  required,  by  type  and  quantity* 

•  Cost 

Employment  Parameter 

•  Critical  performance  interfaces  of  the  system  with  other  systems  to  be 
employed  in  the  mission,  including  total  reaction  time,  error  contribution, 
survival  periods,  target  identification  time,  etc. 

Deployment  Parameter 

•  Kinds  and  levels  of  peacetime -wartime  natural  envliomueuts,  including 
gross  estimates  of  expected  wind  loading,  snow  loading,  precipitation, 
temperature,  humidity,  atmospheric  pressure,  wind  shear,  turbulence, 
vertical  gust  velocities,  energy  input  from  solar  radiation,  particle  mass 
and  energy  spectrum,  etc. ,  as  appropriate 

•  Special  facilities  required  for  system  mission  readiness  state 

•  Cost 


♦Depending  on  the  degree  of  preliminary  design  and  the  establishment  of  operational 
details  during  Concept  Formulation  for  a  particular  application,  defensible  estimates 
of  these  parameters  may  not  be  available. 
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TABLE  3-3 


EXAMPLES  OF  OPERATIONAL  AVAiLABlUTV 
00 i'i Ci.1’ •  b»  AND  p ' * i:'  r' 1  T-'1'  ■' f  - ■  - ■  ■ ; ■  -  i . 


MEASURES, 


Transportation  Parameter 
o  Cubage 

•  Special  handling  facilities  (time  restraints) 

•  Cost 

Personnel  Parameter 

•  Number  of  Wing  level  personnel  which  may  be  allocated  to  the  operation 
and  control  of  the  system.  This  quantitative  figure  is  to  be  compatible 
with  expected  or  anticipated  changes  in  Air  Force  personnel  resources* 

Base  and  Depot  Support  Parameter 

•  AGE  requirements  by  type* 

•  Lead  time* 

•  Spares  distribution* 

•  Cost* 

Training  Parameter 
»  Cost* 

•  Special  training  facilities* 

Test  and  Activation  Parameter 

•  Test  and  activation  equipment  mean  and  maximum  time  to  repair* 

«  Cost* 


l^— ^11^— — — i^M— — ■»  ■  T  WW — WIM— — m— — aan^i—iMi— ^WW—— P— 

*  Depending  on  the  degree  of  preliminary  design  and  the  establishment  of  operational 
details  during  Concept  Formulation  for  a  particular  application,  defensible  estimates 
of  these  parameters  may  not  be  available. 
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Information  Flow 


The  basic  input  data  required  for  die  operational  requirements  analysis  are: 

•  The  operational  requirements  from  the  ROC  and  RAD. 

•  The  preliminary  ROMs,  the  corresponding  mission  objectives  represented 
by  the  FOMs and  the  rationale  for  FOM  selection  from  the  RAD  and/or 
from  tne  effectiveness  activity  of  specifying  preliminary  Figures  of  Merit. 

•  The  proposed  system  maintenance  functions,  operational  test  and  activation 
functions,  Requirements  Allocation  Sheets,  Trade  Studies,  and  Time  Lines 
from  the  Develop  Gross  Functions  activity  of  the  systems  engineering 
management  process  defined  in  AFSCM  375-5. 

•  The  initial  top-level  system  design/performance  requirements,  and  their 
values ,  from  the  Determine  Design  Requirements  activity  of  the  systems 
engineering  process,  also  defined  in  aFSCM  375-5. 

The  results  of  the  operational  requirements  analysis  are  usable  to  establish  the  system 
operational  parameters  critical  to  the  preliminary  FOMs  for  each  candidate  system 
concept.  Upon  an  integrated  analysis  of  the  top-level  system  design/performance 
requirements  later  in  the  effectiveness  process,  the  best  combination  of  parameter 
values  for  a  maximum  system  effectiveness  can  be  determined.  These  values  then 
can  be  used  to  confirm  or  update  the  initial  values  defined  in  this  effectiveness  step 
for  inclusion  in  the  CFP/TDP. 

Figure  3-4  illustrates  the  basic  information  network  for  the  operational  requirements 
analysis.  This  network  is  similar  F  the  performance  requirements  network.  At  this 
point  in  the  effectiveness  process,  an  identification  has  been  made  of  the  totality  of 
top-level  functional,  specialty,  and  operational  system  parameters  influencing  the  pre¬ 
liminary  FOMs.  This  is  the  union  of  the  tw :  sets  of  information  represented  by  the  re¬ 
sults  of  the  performance  requirements  analysis  of  Step  E3,  and  the  operational  require¬ 
ments  analysis  of  this  step. 
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Analysis  Information  Network 

EFFECTIV ENESS  PARAMETER  SE LECTION 


General 


The  performance  and  operational  requirements  analysis  activities  of  Steps  E3  and 
F4,  respectively,  were  directed  at  identifying  the  total  set  of  mission-related  sys¬ 
tem  functions  and  parameters  for  each  system  concept.  The  results  of  the  analyses 
provided  a  broad  perspective  of  the  primary  mission-system  eause-and-exfeet  re¬ 
lationships  potentially  influencing  system  effectiveness.  The  purpose  of  the  effec¬ 
tiveness  parameter  selection  activity  is  to  reduce  the  total  set  of  effectiveness- 
related  system  functions  and  parameters  to  a  simplified  and  analytically  manageable 
subset  of  effectiveness  relationships  and  parameters  which  are  critical  to  the  evalua¬ 
tion  of  system  effectiveness  and  the  preliminary  FOMs.  Principle  technical  elements 
of  the  effectiveness  parameter  selection  activity  include: 


•  The  formulation  of  criticality  matrices 

•  The  identification  of  critical  accountable  factors 

•  The  establishment  of  transfer  functions 

•  The  analysis  for  effectiveness  sensitivity 


Formulate  on  of  Criticality  Matrices 

Criticality  matrices  can  be  used  to  provide  a  gross,  but  visible  rating  of  relative 
importance  of  system  parameters  to  each  other,  and  to  the  FOMs.  In  the  initial 
formulation  ol  the  matrices,  rankings  are  to  be  assigned  based  on  engineering 
judgment.  This  is  a  necessary  beginning  step  to  an  eventual  resolution  of  the  rank¬ 
ings  using  the  results  to  be  obtained  from  applying  the  more  objective  and  scientific 
technique  o,  ross  sensitivity  analysis  later  in  this  step, 

A  criticaliiy  matrix  should  be  prepared  for  each  preliminary  FOM.  The  matrix  is 
formed  by  listing  in  rows  tor  columns)  the  top-  'evel  system  performance  parameters 
postulated  to  have  a  critical  effect  on  the  FOM.  The  critical  first-level  accountable 
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factors  (design  variables)  that  will  significantly  influence  the  range  of  values  for 
the  selected  parameters  are  listed  in  the  remaining  dimension  of  the  matrix.  A 
temporary  numerical  rating  is  then  placed  at  each  applicable  intersection  of  the 
matrix  to  represent  the  criticality  of  each  intersection  relative  to  the  other.  An 
accountable  factor  may  influence  more  than  one  system  parameter,  with  most 
parameters  having  more  than  one  accountable  factor .  Parameters  to  be  included 
in  the  matrix  should  be  those  representing  top-level  functional,  specialty,  and 
operational  system  parameters  contributing  to  the  availability,  dependability,  anci 
capability  of  the  system  for  the  particular  preliminary  FOM  being  analyzed. 

An  accountable  factor  is  critical  to  a  system  parameter,  and  as  a  corollary,  c 
system  parameter  is  critical  to  a  preliminary  FOM,  if  it  is  known  or  suspected 
to  have  a  potential  of  causing  a  significant  effectiveness  change.  This  change  can 
arise  from  the  physical  and  functional  characteristics  of  the  design  whereby  an  in¬ 
cremental  change  in  value  or  precision  of  an  accountable  factor  results  in  a  corres¬ 
ponding  incremental  change  In  the  system  parameter  which  it  influences.  Such 
directional  shifts  may  occur  through  instability,  accumulation  biases,  or  a  deliber¬ 
ate  design  localizing  to  a  particularly  desirable  range  of  values  to  obtain  an  optimum 
performance  behavior.  An  accountable  factor  also  may  be  temporarily  considered 
critical  if  its  relationship  to  the  parameter  is  unknown  and/or  complex  to  define 
during  this  phase,  and  if  its  exclusion  may  cause  a  crucial  error  in  a  system  effec¬ 
tiveness  analysis. 

The  assignment  of  ranking  requires  an  authoritative  perspective  of  the  system  con¬ 
cept  features  under  consideration.  This  knowledge  normally  is  available  by  the  time 
of  conceptual  transition  and  includes: 

•  Knowledge  of  the  gross  performance  potentials  of  first-level  elements 
of  the  system  through  related  experience,  broad  operations  research 
analyses,  and  exploratory  trade-off/eptimization  studies,  including 
early  simulation  analyses 

•  Knowledge  of  gross  interactions  and  response  behavior,  either  directly 
or  through  interpolations  or  extrapolations  from  similar  systems 
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•  Knowledge  of  the  system  elements  or  functions  representing  technological 
advancements  and,  hence,  areas  of  high  technical  risk  with  major  impact 
on  effectiveness. 

Identification  of  Critical  Accountable  Factors 

Accountable  factors  are  the  design  variables  which  influence  the  top-level  system 
performance  parameters  composited  by  the  availability,  dependability,  and  capa¬ 
bility  effectiveness  parameters  of  the  system.  Most  accountable  factors  are  quanti¬ 
fiable  and,  thus,  directly  usable  in  a  numerical  analysis  of  effectiveness.  Nonquan- 
tifiable  accountable  factors  also  exist  for  a  system  design,  and  include  nonphysical 
and  nonfunctional  elements  such  as  design  reviews,  maintenance  and  checkout  pro¬ 
cedures,  etc.  Such  accountable  factors  normally  are  not  usable  in  a  numerical 
analysis  of  effectiveness.  Thus,  only  critical,  quantifiable  accountable  factors  are 
of  relevance  and  are  to  be  identified  during  the  Concept  Formulation  Phase. 

All  accountable  factors  have  constraints .  These  constraints  are  imposed  by  design 
considerations  such  as  the  state  of  technological  advances,  by  apportionments  of 
system  parameters,  and  by  economic  or  resource  limitations.  A  constraint  on  an 
accountable  factor  is  important  only  if  the  margin  existing  for  trade-off  analyses  is 
small  or  is  difficult  to  achieve. 

Nature  of  Transfer  Function 

Transfer  functions  are  the  mathematical  representation  of  system  cause -and-effect 
(input -output)  relationships  and  exist  for  all  system  designs.  Typical  cause-and- 
effect  relationships  influencing  system  performance  and,  correspondingly,  the  pre¬ 
liminary  FOMs,  for  which  gross  transfer  functions  can  be  defined  during  Concept 
Formulation  include: 

Cause /input  Effect/Output 

•  First-level  accountable  System  performance  parameters 

factors 
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CausVlrpu*  (Continued) 


CauB^Output  (Continued) 


•  System  performance  parameters 
or  first-level  accountable 
factors 


Effectiveness  parameters  of 
availability,  dependability, 
and  capability 


•  Effectiveness  parameters,  system  Figures  of  Merit 

performance  parameters,  or  first- 
level  accountable  factors 


The  mathematical  representations  are  based  on  physical  laws,  theoretical  or 
empirical  design,  relationships,  and  probability  concepts,  and  must  be  established 
and  used  if  the  potential  of  a  system  concept  with  respect  to  the  defined  preliminary 
FOMs  is  to  be  analyzed. 

The  top-level  effectiveness  transfer  function  is  the  equation  which  relates  an  FOM 
(E)  to  its  system  effectiveness  parameters  of  availability  (A),  dependability  (D),  and 
capability  (C).  This  relationship  may  be  expressed  as: 

E  =  f  (A,  D,  C) 

where  f  is  a  function  depending  on  the  nature  of  a  defined  preliminary  FOM.  First- 
level  transfer  functions  al3o  can  be  established  to  relate  the  effectiveness  parameters 
of  A,  D,  and  C  to  their  respective  sets  of  system  performance  parameters  which  they 
integrate,  or  directly  to  the  critical  accountable  factors  influencing  the  system  per¬ 
formance  parameters.  An  FOM  also  may  be  directly  related  to  these  factors. 

Additionally,  design  transfer  functions  can  be  associated  with  each  lower  level  that 
the  system  functions  can  be  partitioned ,  with  accountable  factors  identifiable  for  each 
level.  During  the  Concept  Formulation  Phase,  gross  transfer  functions  can  be  con¬ 
structed  based  on  functional  task  analyses,  extrapolations  from  similar  systems, 
theoretical  and  empirical  design  relationships,  probability  concepts,  and  physical 
laws  ,  Such  functions  normally  will  form  the  basis  for  mathematical  or  physical 
simulation  models  to  be  used  for  determining  the  interactive  influences  of  the  account¬ 
able  factors  on  the  performance  of  the  candidate  system.  The  simulation  process  is 
iterative  and  converges  onto  the  broad  functional  solutions  which  describe  the  response 
of  the  effectiveness  parameters  and  system  performance  parameters  to  changes  in 
values  or  precision  of  their  critical  accountable  factors. 
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Gross  transfer  functions  are  to  be  established  and  documented  for  each  system 
p  rformance  parameter  included  in  the  criticality  mat»  ces.  As  a  minimum,  this 
should  include  first-level  functions ,  and  is  to  be  extended  to  second-level  functions 
if  design  details  permit. 

Methods  For  Determining  Transfer  Functions  and  Initial  >Iues 

System  design  fundamentally  involves  dete  rmining  exactly  how  the  elements  of  a 
system  are  to  be  connected,  what  sensitivities  are  best,  the  limitations  of  the  sys¬ 
tem,  its  output  performance  capabilities,  and  the  values  of  input  accountable  factors 
required  to  achieve  the  desired  capabilities.  The  dimensionality  of  the  design 
choices  available  is  extensive,  because  the  number  of  parameters  to  be  fixed  is 
large,  their  range  is  broad,  and  each  is  affected  by  numy  system  inputs.  The  design 
problem  is  complicated  further  because  of  the  statistical  properties  of  the  design 
variables.  Each  of  the  system  input  accountable  factors  has  a  range  of  values,  and 
the  system  responses  to  this  ensemble  of  inputs  must  be  determined. 

The  preliminary  design  of  a  system  for  optimum  system  effectiveness  normally  in¬ 
volves  finding  initial  approximations  of  transfer  functions  to  describe  the  behavioral, 
cause- and-effect  characteristics  of  the  system  for  initial  postulated  or  desired  values 
of  input  accountable  factors  and  output  parameters.  The  synthesis  method  is  a  prac¬ 
tical  procedure  for  determining  transfer  functions  given  this  minimum  of  knowledge. 
Table  3-4  summarizes  the  application  characteristics  of  the  synthesis  method,  with 
a  more  detail  description  of  the  method  presented  in  Appendix  B,  Part  Bl. 

Analysis  For  Sensitivity 

The  formulation  and  definition  of  a  system  concept  with  maximum  effectiveness  require 
a  judicious  selection  of  the  design  value  for  each  critical  accountable  factor  so  that  an 
optimum  combination  of  values  for  the  output  parameters  (system  and/or  effectiveness 
parameters)  will  result.  The  selection  of  the  best  design  values  will  be  dependent  upon 
the  amount  of  visibility  present  on  the  quantitative  influence  of  each  critical  accountable 
factor  to  its  output  parameter(a).  Normally,  the  complex  transfer  functions  previously 
described  are  used  in  simulation  or  theoretical  analyses  to  provide  thi«  perspective. 
Durirg  Concept  Formulation,  however ,  a  need  exists  for  broadly  converging  onto  these 
quantitative  cause -and-effect  relationships.  Sensitivity  functions  can  be  used  for  thi« 
purpose  and  can  be  developed  as  simplified  resolutions  of  the  more  complex  relationships 
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TABLE  3-4  CHARACTERISTICS  OF  SYNTHESIS  METHOD 


Characteristic 


Synthesis  Method 


•  Phase  normally 
applicable 

•  Ease  of  application 

c.  Relationship  of 
variables* 

•  Information  needed 
to  start  preliminary 
design 

•  Input-output 
expression  for  linear, 
time -varying  systems 

•  Procedure 


•  Optimizing 
procedure 
(example) 


•  Error  criterion 
(example) 


•  Solution  method  for 
simple,  linear  time- 
varying  systems 

•  Solution  method  for  complex, 
linear  and  non-linear 
time-varying  systems 

•  Special  technique  to  facilitate 
solution  for  linear, 

time -varying  system 


Concept  Formulation  and  Contract 
Definition 

Difficult 

Transfer  functions  are  implicit 
functions  of  inputs  and  outputs 

Minimum  amount.  Requires 
knowledge  of  inputs  and  outputs. 
Then  find  transfer  functions 

Provided  by  a  superposition 
integral 


Find  transfer  functions  to  satisfy 
superposition  integrals.  Then 
find  physical  characteristics  of 
system  which  satisfy  transfer 
functions 

Find  transfer  function  such  that  the 
difference  (error)  between  each  out¬ 
put  and  the  true  output  in  as  small 
as  possible,  using  this  transfer 
function 

(1)  minimum  time-averaged  squared 
difference  or  absolute  difference,  or 

(2)  minimum  expected  value  of  squared 
difference 

Determine  transfer  functions  using 
vector  analysis,  matrix  theory,  and 
Laplace  transforms,  for  example 

Combination  of  numerical  and  analytical 
procedures  using  digital  computations 


No  simple  method 


♦Inputs  and  outputs  normally  are  in  the  form  of  time -functions 
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expressed  by  the  transfer  functions.  The  sensitivity  functions  are  generated  also  by 
simulations  or  theoretical  analyses. 

The  procedure  for  generating  sensitivity  functions  involves  the  following  basic  steps: 

(1)  Postulate  an  initial  nominal  value,  a  standard  deviation  value,  and  a  candidate 
range  of  achievable  values  for  all  critical  accountable  factors  influencing  each 
output  parameter  under  investigation.  These  values  will  normally  be  based 
upon  the  initial  broad  trade-off  studies  which  established  the  feasibility  of  the 
system  concepts,  and  on  the  functional  analyses  performed  to  establish  the 
system  performance  parameters  required  to  meet  the  mission  objectives. 

(2)  With  the  previously  identified  critical  accountable  factors  for  each  output 
parameter,  perform  a  simple  simulation  or  theoretical  analysis  of  the  account 
able  factors  to  determine  the  best  value,  or  the  region  where  potentially  the 
best  value  may  be  contained.  Use  the  range  of  achievable  values  and  the 
transfer  functions  established  with  the  synthesis  method  as  the  starting  point 
for  the  simulation  or  theoretical  analysis.  For  each  accountable  factor  which 
independently  influences  an  output  parameter,  vary  its  value  within  the  candi¬ 
date  range  of  achievable  values,  while  maintaining  all  other  accountable 
factors  at  their  postulated  nominal  value.  For  accountable  factors  which  have 
mutual  interactions,  the  same  procedure  may  be  followed,  except  that  the 
effects  due  to  these  factors  are  assessed  by  a  pairwise  or  otherwise  mutual 
scanning  of  the  values  over  their  preestablished  probable  range. 

(3)  Portray  the  sensitivity  of  the  effectiveness  parameter  to  the  range  of  values 
for  each  accountable  factor  (or  sets  of  factors  where  interactions  are  present) 
by  plotting  the  response  value  of  the  parameter  for  each  change  in  value  of 
the  accountable  factor.  Describe  this  response  with  a  curve  and  a  simple, 
approximate  mathematical  function,  which  normally  will  be  nonlinear. 

(4)  Approximate  the  nonlinear  curve  or  function  with  a  linear  curve  or  function  in 
the  region  wher'  the  best  values  are  present.  Mathematical  transformations 
can  be  used  to  accomplish  hiu  linearization.  The  linearization  of  the  cause- 
and-effcct  relationships  is  a  practical  necessity  to  (a)  provide  a  perspective  of 
the  relative  criticality  of  accountable  factors  to  each  other,  and  to  the 
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effectiveness  parameters,  (b)  facilitate  simple  analysis  of  the  response  distribution  for 
the  effectiveness  parameter,  and  (c)  eliminate  interactive  effects.  Examples  of 
sensitivity  curves  are  shown  in  Figure  3-5. 

Each  sensitivity  curve  or  function  thus  generated  will  relate  the  amount  of  change  in  an 
output  parameter  for  a  fixed  incremental  change  of  one  of  its  accountable  factors.  With 
these  visible  cause-and-effeet  relationships,  an  index  can  be  established  of  the  relative 
'’riticality  of  the  accountable  factors  to  each  other,  and  to  the  output  parameter(s)  they 
influence.  Additionally,  the  results  of  the  sensitivity  analysis  will  provide  a  scientific 
basis  for  revision  of  the  accountable  factors  to  be  included  in  the  criticality  matrix  and 
the  preliminary  rankings  previously  assigned.  For  example,  the  initial  broad  rankings 
can  be  converted  to  sensitivity  coefficients  based  on  one  of  the  following  forms: 

•  The  incremental  amount  of  change  in  an  output  parameter  expected  for  a 
normalized  incremental  change  of  an  accountable  factor  (o.g. ,  a  standard 
deviation  change).  The  normalizing  of  the  accountable  factor  is  required 
because  of  the  difficulty  in  assessing  the  relative  importance  of  different 
increments  of  change  for  accountable  factors  of  different  measurement  units. 

•  The  amount  of  change  required  for  each  accountable  factor  for  a  fixed  incre¬ 
ment  of  improvement  in  the  output  parameter  (e.g. ,  a  .05  increase  in  its 
probability  measure). 

Normally,  sensitivity  functions  for  natural  environmental  factors  which  express  their 
direct  relationships  to  the  output  parameters  will  not  be  required  diming  Concept  Form¬ 
ulation.  While  natural  environmental  factors  technically  are  accountable  factors  for 
system  behavior,  they  directly  affect  the  design  values  achievable  by  the  critical 
accountable  factors .  The  natural  environmental  factors  cause  a  critical  accountable 
factor  to  depart  from  a  desired  output  value  in  the  form  of  a  shift  in  its  design  nominal 
value,  or  excessive  variation  in  its  output  distribution  and,  therefore,  can  be  considered 
as  belonging  to  a  class  of  lower-level  accountable  factors  to  be  analyzed  in  later  phases. 

With  the  sensitivity  relationships,  a  preliminary  optimization  of  each  output  parameter 
can  be  accomplished.  This  n  it  be  tempered  with  a  composite  FOM  and  cost 
optimization  described  in  a  later  step.  A  description  of  the  output  distribution 


for  each  output  parameter  also  can  be  made.  With  all  sensitivity  functions 
linearized,  the  mean  of  the  output  distribution  is  directly  obtainable  front  the  transfer 
functions.  This  is  the  response  value  corresponding  to  the  critical  accountable  factors 
being  assigned  their  selected  optimum  nominal  value.  The  variance  (a  measure  of 
variation)  can  be  estimat  ed  as  the  sum  of  the  postulated  inherent  variances  for  each 
accountable  factor.  An  estimate  then  can  be  determined  for  the  probability  that 
an  output  parameter  will  exceed  a  limiting  value.  These  are  required  inputs  for  an 
FOM  evaluation. 

An  alternate  procedure  for  determining  the  response  distribution  is  to  use  a  standard 
procedure  such  as  Monte  Carlo  simulation.  Such  a  complex  procedure  normally  should 
not  be  attempted  unless  sufficient  design  details  are  available. 

Procedure 

The  procedure  for  the  technical  accomplishment  of  the  effectiveness  parameter  selection 
step  can  be  summarized  by  the  following  general  activities: 

•  Identify  those  system  functions  and  parameters  which  are  critical  to  the  pre¬ 
liminary  FOMs.  (For  example,  assume  that  the  FOM  prescribed  for  a  close- 
support  aircraft  is  tha  probability  that  a  single  aircraft  will  destroy  an  assigned 
target  of  a  specified  posture.  Ideally,  a  close -support  aircraft  would  be  assigned 
to  destroy  as  many  targets  and  make  as  many  passes  as  its  weapon  delivery  capa¬ 
bility  would  allow.  Additionally,  if  an  aircraft  has  a  low  probability  of  kill  per 
pass,  multiple  aircraft  may  be  committed  as  a  normal  tactic.  For  such  a  system, 
the  primary  contributions  to  effectiveness  are  supplied  by  the  navigation,  target 
acquisition,  and  weapon  delivery  functions.  One  area  where  a  significant  payoff 
in  effectiveness  is  apparently  present  is  by  increasing  navigation  accuracv.  This 
will  (1)  enhance  the  ability  to  locate  the  identification  point  under  marginal  weather 
conditions,  (2)  increase  probability  of  acquiring  targets  under  marginal  weather 
conditions,  (3)  decrease  pilot  workload,  thus  enhancing  survivability  through  reduced 
pilot  errors,  and  (4)  provide  greater  accuracy  of  inputs  to  the  bombing  computer. 
One  of  the  critical  functions,  therefore,  is  the  navigation  function  with  the  needed 
navigation  accuracy  being  its  critical  performance  parameter. ) 
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•  Identify  quantifiable,  critical  accountable  factors  for  each  critical  system 
performance  parameter  contributing  to  the  effectiveness  parameters  of 
availability,  dependability,  and  capability. 

e  Establish  a  criticality  matrix  for  each  FOM  to  provide  a  visible  perspective 
of  the  relative  contribution  to  the  FOM  and  each  effectiveness  parameter  of 
the  critical  top-level  system  parameter  and  its  accountable  factors 

•  Assign  preliminary  rankings  of  criticality 

■»  Develop  the  needed  set  of  gross  transfer  functions  to  describe  raathemeticaily 
the  functional  cause -and-effect  relationships  of  the  critical  accountable  factors 
to  their  system  performance  parameters .  Examples  of  transfer  functions  are 
listed  in  Table  3-5. 

•  Analyze  the  sensitivity  of  each  selected  output  performance  parameter  to  a 
candidate  range  of  achievable  values  for  its  critical  accountable  factors,  using 
simplified  simulation  or  theoretical  analysis  techniques.  Portray  the  response 
with  a  curve  and  a  simple  mathematical  function 

•  Identify  the  response  region  where  the  best  values  for  optimum  results  are 
included.  Linearize  the  function  (or  curve)  in  this  region. 

•  Convert  the  results  of  the  sensitivity  analysis  to  sensitivity  coefficients. 

Revise  composition  and  rankings  of  criticality  matrix  as  needed. 

Information  Flow 

The  basic  data  required  for  the  effectiveness  parameter  selection  activity  are: 

•  The  results  of  the  performance  requirements  analysis  of  Step  E3 

•  The  results  of  the  operational  requir  ements  analysis  of  Step  E4 

•  The  proposed  system  maintenance  functions,  operational  test  and  activation 
functions,  Requirements  Allocation  Sheets,  Trade  Studies,  and  Time  Lines 
from  the  Develop  Gross  Functions  activity  of  the  systems  engineering  process 
as  described  in  AFSCM  375-5 

•  The  initial  system  design/performance  requirements,  and  their  values,  from 
the  Determine  Design  Requirements  activity  of  the  systems  engineering 
process  as  described  in  AFSCM  375-5 
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TABLE  3-5  EXAMPLES  OF  TRANSFER  FUNCTIONS 


Transfer  Function 

Accountable  Factor 

• 

Basic  availability  equation  (A) 

Reaction  time 

Mean  time  to  preventive  maintenance 

Mean  time  required  for  repair 

Mean  time  to  failure 

• 

Basic  dependability  equation  (D) 

Operating  time 

Failure  rate 

In-flight  repair  rate 

• 

Basic  survivability  equation  (D) 

Dispersion 

Hardness 

Reaction  time 

• 

Available  flights  per  month 
for  aircraft  systems  (A) 

Mean  turnabout  time 

Fraction  of  total  time  in  flight 

Mean  time  to  restore 

• 

Breguet  range  equation  for 
aircraft  systems  (C) 

Lift  and  drag  coefficients 

Weight  of  aircraft  at  takeoff  and  at  landing 
Density  of  atmosphere 

Specific  range  of  fuel 

Wing  area 

• 

Drpg  equation  for  aircraft 
or  missile  systems  (C) 

Maximum  frontal  area 

Angle  of  attack 

Velocity 

Density  of  atmosphere 

• 

Maximum  range  equation  for 
ballistic  missile 
systems  (C) 

Earth's  radius 

Earth's  surface  gravity 

Burnout  velocity 

• 

Point  target  kill  probability 
equation  for  missile  systems  (C) 

Radius  of  effect  of  ordnance 

Accuracy  of  delivery  of  ordnance 

• 

Thrust  equation  for  booster 
systems  (C) 

Nozzle  throat  area 

Thrust  coefficient 

Chara  -teriatlc  exhaust  velocity 
Chamber  pressure 


TABLE  3-5  EXAMPLES  OF  TRANSFER  FUNCTIONS  (Continued) 


Transfer  Function 

Accountable  Factor 

• 

Equation  of  motion  for  booster 
systems  (C) 

Velocity  of  exhaust 

Direction  and  magnitude  of  thrust, 
forces 

Mass  vs.  time  curve 

• 

Kepler's  laws  for  orbital 
period  and  velocity  for 
satellite  systems  (C) 

Maximum  and  minimum  distance  of  satellite 
from  the  center  of  the  earth  or  other 
attracting  body 

Mass  of  attracting  body 

• 

Transfer  period  sensitivity 
equation  for  spacecraft 
systems  (C) 

Velocity  of  vehicle  and  error  in  velocity 
Orbital  parameters 

• 

Rayleigh  scattering  law 
for  small  objects  for 
radar  systems  (C) 

Wavelength  of  radar 

Radius  of  object 

• 

Range  equation  for  radar 
systems  (C) 

System  loss  factor 

Transmitted  power 

Cross  section  of  detected  object 

Power  gain  of  the  antenna 

Radar  wavelength 

Signal -to-noise  ratio 

• 

Probability  of  detection 
equation  for  radar 
systems  (C) 

Threshold  voltage 

Amplitude  of  signal  or  noise 

• 

Spiral  search  acquisition 
probability  equation  for 
radar  systems  (C) 

Distance  between  curves  on  spiral 

One  sigma  acquisition  radius 

Number  of  sensors 

Single  pass  acquisition  probability 

Dispersion  in  probable  location  of  target 

(A)  denotes  availability  function 
(D)  denotes  dependability  function 
(C)  denotes  capability  function 
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•  The  ROC  and  RAD  requirements  and  preliminary  FOM  descriptions 

•  The  theoretical  and  empirical  design  equations,  physical  laws,  and 
probability  relationships  used  to  relate  the  ensemble  of  broad  system  inputs 
to  outputs  from  the  initiai  concept  trade-off  studies. 

The  results  of  the  effectiveness  parameter  selection  activity  will  be  used  to  structure 
the  effectiveness  models  to  be  applied  for  the  evaluation  and  optimization  of  the  candi¬ 
date  system  concepts  with  respect  to  the  FOM  measures.  Upon  completion  of  the  sub¬ 
sequent  effectiveness  evaluation  and  optimization  analysis,  a  final  adjustment  of  the 
criticality  .matrix  may  be  necessary  prior  to  its  inclusion  in  the  CFP/TDP. 

Figure  3-6  shows  the  basic  information  network  of  the  effectiveness  parameter 
selection  activity. 


3-7  MODEL  STR'JCTUBING 


STEP  E6 


General 

Effectiveness  models  are  required  to  evaluate  the  capabilities  of  the  candidate  design 
concepts  with  respect  to  their  current  and  projected  performance  potentials  and  economy. 
These  models  are  usually  in  the  form  of  mathematical  equations  suitable  for  direct  or 
computer  simulation  analysis .  A  system  effectiveness  model  is  used  to  measure 
technical  performance  as  a  function  of  either  the  effectiveness  parameters  of  avail¬ 
ability,  dependability,  and  capability,  or  as  a  direct  function  of  the  critical  system 
parameters  composited  by  the  effectiveness  parameters.  A  cost  model  is  used  to 
measure  the  cost  performance  of  the  candidate  designs  based  on  the  resource  parameters. 
A  cost  effectiveness  model  provides  a  measure  of  the  relative  merits  of  the  designs  with 
respect  to  the  efficient  balance  of  technical  performance  and  cost. 

System  effectiveness  models  are  to  be  developed  for  each  defined  preliminary  FOM. 

These  models  are  to  be  adaptive  for  the  evaluation  of  multi -threats ,  alternate  modes  of 
operations,  critical  accountable  factors,  and  similar  influences  which  may  measurably 
affect  the  FOM  potential  of  a  system.  System  effectiveness  models  normally  will  con¬ 
sist  of  several  submodels,  with  each  submodel  based  on  models  at  still  lower  levels. 
Because  of  the  interactions  among  the  submodels,  model  integration  will  be  necessary. 
Where  design  details  permit  during  Concept  Formulation,  first -level  system  submodels 
are  to  be  formulated  in  addition  to  top-level  models. 

System  and  cost  effectiveness  submodels  which  may  be  structured  for  the  evaluation  of 
the  spectrum  of  technical  performance  parameters  of  a  system  include  models  for: 

•  Each  effectiveness  parameter 

•  .  Each  subsystem  FOM,  reflecting  the  contributions  to  the  system  FOMs  of  the 

restrictive  mission  objectives  associated  with  a  subsystem's  capabilities  and 
role  in  each  mission  assignment  (normally  not  required  during  Concept 
Formulation). 

•  Each  critical  accountable  factor  (normally  not  required  during  Concept 
Formulation) . 


3-42 


\ 


The  structuring  of  effectiveness  models  during  Concept  Formulation  is  a  four-step 
process  involving: 

•  Defining  analysis  assumptions 

•  Formulation  of  effectiveness  parameter  models 

•  Integration  into  overall  FOM  models 

•  Integration  of  FOM  models  into  overall  cost  effectiveness  models 
Defining  Analysis  Assumptions 

Prior  to  the  formulation  of  an  effectiveness  analysis  model,  a  listing  of  assumptions, 
including  their  explicit  rationale  and  justification,  is  required.  This  listing  should 
include  the  major  assumptions  influencing  the  validity,  credibility,  realism,  and  con¬ 
fidence  to  be  attached  to  the  model  and  model  outputs.  Assumptions  to  be  listed  and 
justified  during  Concept  Formulation,  in  order  of  decreasing  criticality,  include  those 
addressing  technical  uncertainties  associated  with: 

(1)  FOM  definition 

(2)  Mission  scenarios  and  strategic  content,  mission  performance  and 
operational  requirements,  and  mission  conditions  (most  probable  and 
worst  situation) 

(3)  Transfer  functions,  procedures  used  to  generate  these  functions,  system 
performance  parameters,  and  accountable  factors,  including  values 
achievable. 

(4)  Source  data  representativeness 

(5)  Mathematical  approximations  used  to  simplify  analysis,  form  of  probability 
distributions  for  the  ensemble  of  system  input-output  functions,  linearity 
approximations,  and  dependencies  or  interactions  of  functions. 

To  the  extent  possible,  unifying  sets  of  assumptions  should  be  preestablished  for  (1) 
and  (2)  by  the  AF  technical  activities  and  reflected  in  the  RAD.  These  assumptions 
should  cover  any  basic  uncei'tatnties  about  the  mission  content  and  the  requirements 
against  which  system  terminal  performance  is  to  be  measured. 
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While  the  evaluation  of  FOMs  and  their  effectiveness  parameters  is  sensitive  to  the 
nature  and  criticality  of  assumptions,  it  is  also  sensitive  to  the  validity  of  the  rationale 
and  justifications  underlying  the  assumptions.  In  turn,  the  validity  of  the  rationale  and 
justiciations  used  for  the  needed  assumptions  is  dependent  upon  the  quality  of  the 
supporting  data  base  to  be  used.  In  an  order  of  decreasing  quality,  the  following- data 
bases  are  normally  usable  to  support  assumptions  during  Concept  Formulations 

(1)  Proven  concepts  and/or  facts  substantiated  by  in-depth  studies  (e.g. ,  war 
game  analysis,  in-depth  intelligence  reports,  minor  extensions  of  current 
state-of-the-art,  etc.) 

(2)  Repeatable  experimental  results  verifiable  by  theory 

(3)  Theoretical  or  scientific  hypotheses  not  verified  experimentally  nor 
empirically. 

(4)  Major  extrapolations  from  similar  or  related  systems 

(5)  Engineering  guesses 

The  composite  influence  of  the  nature  and  criticality  of  assumptions  made,  and  of  the 
validity  of  the  justifications  for  these  assumptions,  is  an  error  in  the  calculated  value 
for  each  FOM.  The  largest  error  will  be  associated  with  the  use  of  many  highly 
critical  assumptions  and  insufficient  justifications .  A  determination  of  the  magnitude 
of  the  composite  error  can  be  made  based  on  worst  case  analysis  and  reflected  in  the 
calculated  FOM  in  terms  of  an  interval  (e.g. ,  plus  and  minus  three  standard  deviations) 
in  which  the  FOM  value  is  expected  to  be  included.  Where  data  permit,  this  interval 
is  extendable  to  include  statistical  uncertainties  (risks). 

Formulation  of  Effectiveness  Parameter  Models 

Models  are  to  be  formulated  for  each  effectiveness  parameter  of  availability,  depend¬ 
ability,  and  capability  to  integrate  their  respective  set  of  system  performance  para¬ 
meters.  In  the  formulation  of  these  models,  many  decisions  must  be  made.  These 
decisions  basically  address  the  extent  to  which  the  presence  of  certain  operational 
conditions  will  significantly  Influence  the  effectiveness  parameters  and  the  FOMs, 
such  as  different  system  states,  multiple  threats,  and  multiple  missions. 
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Mission  accomplishment  is  directly  affected  by  the  different  significant  states  that 
the  system  may  occupy  during  its  mission  assignments .  These  states  refer  to  the 
different  functional  conditions  of  the  system  at  the  beginning  of  the  mission,  during 
the  mission,  and  upon  completion  of  the  mission.  For  a  complex  system,  there 
theoretically  may  be  a  continuous  spectrum  of  system  states.  One  extreme  of  the 
spectrum  is  represented  by  the  state  associated  with  the  system  completely  func¬ 
tioning  properly  without  error,  the  fully  operable  state  (mission  not  aborted).  The 
opposite  extreme  is  the  state  associated  with  the  system  completely  inoperable 
(mission  aborted).  A  significant  intermediate  state  would  be  the  fail-operable  con¬ 
dition  of  the  system  (major  elements  of  the  system  failed,  but  not  requiring  mission 
abort).  From  a  practical  implementation  viewpoint,  it  is  necessary  to  group  states 
to  reduce  their  total  number  to  a  manageable  size  suitable  for  rapid  effectiveness 
evaluations.  Thus,  during  Concept  Formulation,  it  is  expected  that  system  functional 
analyses  will  only  be  of  sufficient  detail  to  allow  for  a  simplified  two-state  analysis 
(operable  and  Inoperable  states).  j\,. 

In  addition  to  selecting  and  defining  the  significantly  different  states  to  be  addressed 
by  each  effectiveness  parameter  model,  specific  technical  details  necessary  for  over¬ 
all  model  integration  and  evaluation  of  a  system's  FOMs  are  to  be  developed.  These 
are: 

•  A  graphical  representation  of  the  system  progression  from,  state  to  state 
during  the  time  periods  of  the  missions.  Figure  3-7  illustrates  a  typical 
system  effectiveness  state  flow  graph  for  a  simplified  two-state  analysis. 

For  this  representation,  the  states  are  considered  to  be  applicable  over 
the  entire  mission  profile,  independent  of  time  intervals  for  which  the 
mission  may  be  partitionable. 

•  The  determination  of  probabilities  for  each  of  the  significant  mission 
states.  For  a  system  which  is  considered  to  occupy  only  one  of  the  two 
states  of  operable  and  inoperable  at  any  time  prior  to,  during,  or  at  the 
end  of  the  mission,  estimates  are  required  of  the  probable  occurrence  of 
each  state. 
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Mission  accomplishment  is  further  influenced  by  the  type  and  magnitude  of  natural 
environments  and  hostile  enemy  threats .  As  previously  indicated  in  the  Effectiveness 
Parameter  Selection  Step,  natural  environmental  stresses  normally  can  be  considered 
and  evaluated  as  influences  to  critical  accountable  factors.  Their  range  of  values  are 
reasonably  and.  accurately  predictable.  On  a  comparative  basis,  the  type  and  magnitude 
of  hostile  enemy  threats,  previously  identified  in  the  Mission  Analysis  Step,  will  have 
the  more  serious  effect  on  performance.  When  considering  the  influences  of  different 
types  and  magnitudes  of  enemy  threats,  an  analysis  based  on  the  most  probable  level  of 
threat  can  result  in  the  selection  of  a  system  concept  which  may  be  extremely  Ineffective 
in  the  presence  of  a  different  and  worse  level  of  threat.  The  selection  of  a  system  which 
can  respond  to  the  worst  level  of  threat,  although  it  may  have  a  low  probability  of 
occurrence,  also  may  have  unsatisfactory  consequences  because  of  the  conservatism 
of  this  approach  and  its  usual  high  attendant  cost.  A  technical  decision  Will  be  required 
as  to  the  manner  in  which  multiple  threat  influences  are  to  be  reflected  in  the  analytical 
results.  A  practical  procedure  to  follow  is  to  establish  distinctly  different  groupings  of 
threats  by  severity  level,  on  the  order  of  approximately  four  levels,  with  probabilities 
assigned  for  the  expected  occurrence  of  each  level.  Each  effectiveness  parameter 
should  then  be  evaluated  against  each  defined  level.  As  a  minimum,  the  effect  of  the 
most  probable  and  the  most  severe  levels  should  be  assessed  to  provide  a  common 
comparative  basis  for  concept  selection  decisions. 

Multiple  missions  impose  additional  conditions  on  the  formulation  of  the  analytical 
models  for  the  effectiveness  parameters.  Different  mathematical  expressions  for  the 
models  will  be  required  for  each  mission  in  the  majority  of  cases.  Additionally, 
model  outputs  must  be  in  the  same  measurement  unit  if  FOMs  are  to  be  combined. 
Multiple  modes  of  operation  also  will  require  a  separate  modeling  consideration. 

Integration  Into  Overall  FOM  Models 

In  addition  to  defining  and  formulating  the  analytical  models  for  tfcn  individual  eval¬ 
uation  of  the  effectiveness  parameters,  a  composite  system  effectiveness  model  must 
be  developed  for  each  of  the  defined  preliminary  FOMs.  These  composite  models  will 


be  the  analytical  mechanisms  for  the  quantitative  determination  of  a  system's 
technical  FOM  potentials.  Also,  the  development  of  an  overall  system  cost  model 
will  be  required,  as  well  as  a  cost  effectiveness  model  to  integrate  the  system 
effectiveness  and  cost  models. 

The  structuring  of  each  system  effectiveness  model  is  a  two-step  process .  Ini¬ 
tially,  the  submodels  for  the  critical  functional,  specialty,  and  operational  system 
parameters  are  composited  into  their  respective  effectiveness  parameter  sets  of 
availability,  dependability,  and  capability.  A  typical  procedure  would  be  to  apply 
a  product  rule,  since  the  individual  system  parameters  normally  are  independent, 
or  can  be  subgrouped  into  more  inclusive  independent  parameters.  Following  this 
step,  the  effectiveness  parameter  sets  then  can  be  integrated  into  overall  FOM  models. 
Examples  of  simplified  overall  system  effectiveness  models  useful  for  application  dur¬ 
ing  Concept  Formulation  are  presented  in  Table  3-6. 

Integration  Into  Overall  Cost  Effectiveness  Models 

The  integration  of  the  separate  system  effectiveness  models  and  cost  models  into  a 
single  cost  effectiveness  model  for  each  set  of  mission  objectives,  and  the  analytical 
results  obtainable  from  the  use  of  the  integrated  models,  provide  a  comparative  basis 
for  system  concept  selection.  Additionally,  by  comparing  the  cost  effectiveness  of 
the  preferred  concept  to  that  of  competing  systems  on  a  DOD-wide  basis,  a  determin¬ 
ation  can  be  made  of  the  preferred  system's  performance-cost  stance.  A  favorable 
comparative  result  is  one  of  the  prerequisites  for  obtaining  conditional  approval  to 
proceed  with  the  Contract  Definition  Phase  and  subsequent  engineering  development. 

Examples  of  cost  effectiveness  models  useful  for  Concept  Formulation  applications 
are  listed  in  Table  3-7.  The  structuring  of  the  cost  effectiveness  model  involves  de¬ 
fining  the  cost  effectiveness  selection  criteria  (a  single  criterion  for  single  mission 
systems)  which  is  to  be  used  as  a  common  measure  for  all  competing  system  concepts. 
Normally,  the  criteria  are  to  be  stated  in  units  of  dollar  cost  per  unit  of  mission  task 
performed,  or  the  equivalent  inverse  form.  Examples  of  cost  effectiveness  measures 
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TABLE  3-6  EXAMPLES  OF  SIMPLIFIED  SYSTEM  EFFECTIVENESS 
MODELS  FOR  CONCEPT  FORMULATION  APPLICATIONS 


Type  of  Mission  Characteristic  Model 

|  SIMPLE  DISCRETE  AND  CONTINUOUS  MISSIONS  1 

o  Discrete  (with 
respect  to  mission 
time) 


Non-recurring 


Recurring 


Mission  is  short  in  duration, 
and  system  expended  after 
one  mission  assignment 


System  is  reusable  and  is 
operationally  employed  on 
many  assignments  to  ac¬ 
complish  the  same  set  of 
mission  objectives 


FOM  evaluated  as  simple 
ADC*  product,  or  as  an 
average  or  minimum 
capability. 

FOM  is  a  measure  of  average 
or  minimum  capability 


• 

Continuous  (with 
respect  t  >  missi  >n 
time) 

System  is' operationally 
employed  over  an  extended 
period  of  time 

FOM  is  integral  over  time 
of  ADC  product,  with  D  and  C 
potentially  changing  with  time. 
Where  a  worst  case  analysis 
is  appropriate,  the  FOM  is  a 
minimum  value  of  the  ADC 
product 

|  COMPLEX  DISCRETE  AND  CONTINUOUS  MISSIONS  | 

• 

Multiple  levels 
of  threats 

System  is  operationally 
employed  in  the  face  of 
all  threat  levels 

Effectiveness  E  is  min  {E,}  or 
most  probable,  where  E-  is 

FOM  for  i-th  threat  level.  Also, 

E  may  be  expressed  as  E  p,E^, 

where  pj  is  the  probability  of  i-th 
threat  level  occurring 

• 

Multiple  missions 
for  discrete  and 
continuous  missions 

System  is  operationally 
employed  for  a  variety  of 
missions.  A  composite 

FOM  for  all  missions  can 
be  realistically  defined 

E  is  min  {  Ej}  or  most  probable, 
where  Ej  is  FOM  for  j-th  set 
of  mission  objectives.  Also, 

E  may  be  expressed  as  Zpj  Ej, 
where  pj  is  probability  of  j-th 
mis  sion  occurring 

• 

Multiple  missions 
and  threats 

System  is  operationally 
employed  in  the  face  of  all 
threat  levels  and  for  a  vari¬ 
ety  of  missions.  A  composite 
FOM  for  all  missions  can  be 
realistically  defined 

E  is  min  {  E-u}  or  most  probable. 
Also,  E  may 'be  expressed  as 

£  £  p..  E.. 
i  i  u  u 

*  A 

=  Availability 

D  =  Dependability  C  = 
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Capability 

TABLE  3-7  EXAMPLES  OF  COST  EFFECTIVENESS  MODELS 


•  System  effectiveness  (E)  for  a  fixed  cost  (C) 

•  Cost  (C)  for  a  fixed  level  of  system  effectiveness  (E) 

•  System  effectiveness  (E)  per  cost  (C),  or  cost  (C)  per  system  effectiveness  (E)  - 
(Ratio  Model) 

•  Net  value*  (V)  received  for  cost  (C)  expended  -  (Net  Value  Received  Model). 

Can  be  expressed  as: 

Net  value  received  =  VE  -  C 

=  gross  value  received  minus  cost 

=  value  per  increment  of  effectiveness  times  planned 
level  of  effectiveness  minus  cort 

•  Net  rate  of  return  per  unit  of  cost  -  (Rate  of  Return  Model).  Can  be  expressed 
as: 

vp  _  f 

Net  rate  of  return  =  - ^ — 

=  Net  value  received  per  cost 


•  Gross  value  received,  averaged  over  entire  life  of  system,  per  cost  (C)  - 
(Long  Term  Ratio  Model).  Can  be  expressed  as: 


c<C-  V 


J  V(t)  Eft)  dt 
4d 


where  (to  -  t^)  is 
remaining  useful  life 


*Value  (V)  is  assignable  to  a  fixed  increment  of  system  effectiveness  (e.  g. ,  X  dollars 
per  .05  increment  of  E),  and  is  expressed  in  units  of  cost  (C)  per  effectiveness  (E). 
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for  various  classes  of  Air  Force  systems  are  listed  in  Table  3-8.  This  table  is 
essentially  a  derivative  of  Table  3-1,  Figure  of  Merit  Examples,  previously  de¬ 
scribed  in  paragraph  3-3.  A  criterion  for  system  selection  which  is  responsive 
to  mission  objectives  is  typically  based  on  one  of  the  following  rules: 

(1)  The  maximum  system  effectiveness  for  a  fixed  cost 

(2)  The  maximum  system  effectiveness  per  unit  of  cost,  or  its  invei*se. 

Rules  (1)  and  (2)  will  have  general  applicability  during  the  Concept 
Formulation  Phase. 

(3)  The  minimum  cost  for  a  level  of  system  effectiveness. 

Formulation  of  Cost  Models 

Tasks  and  factors  relevant  to  the  construction  of  a  cost  model  for  each  set  of  mis¬ 
sion  objectives  to  provide  a  quantitative  analysis  of  the  total  system  costs  involve 
the  following: 

•  Identification  of  cost  resources  and  constraints  (schedule  demands,  size 

of  commodities  such  as  operating  skins,  critical  material,  technology,  and 
dollars) 

•  Identification  and  synthesis  of  cost  alternatives,  including  the  affected  criti¬ 
cal  accountable  factors  and  system  performance  parameters 

•  Development  of  cost  relationships  and  the  cost  models . 

Cost  measures  should  be  capable  of  accommodating  the  assessment  of  major  types  of 
resource  expenditures  on  a  common  basis,  sucb  as  dollar  cost.  Toward  this  end,  the 
development  of  cost  models  will  be  needed  to  evaluate  separately  the  major  components 
of  total  cost.  These  are  the  components  of  development  costs,  acquisition  costs,  and 
operational  costs  (including  logistics  support  elements  such  as  maintenance).  Addi¬ 
tionally,  separate  evaluation  of  costs  will  bo  required  for  alternate  development  schedule 
time  spans,  if  appropriate,  and  if  the  time  span  alternatives  are  sufficiently  different 
so  as  to  affecv  the  efficient  utilization  of  resources . 
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TABLE  3-8  EXAMPLES  OF  COST  EFFECTIVENESS  MEASURES 


System  Class 


Cost  Effectiveness  Measure* 


•  Interceptor  (a)  Expected  number  of  enemy  aircraft  destroyed 

per  unit  of  cost 

(b)  Expected  number  of  hours  of  training  per  unit 
of  cost 


•  Strategic  Bomber 


•  Tactical  Aircraft 


(a)  Expected  number  of  point  targets  destroyed  per 
unit  of  cost 

(b)  Expected  number  of  hours  of  training  per  unit 
of  cost 


(a)  Expected  number  of  sorties  per  unit  of  cost 

(b)  Expected  number  of  successful  close  air  supports 
per  unit  of  cost 

(c)  Expected  number  of  successful  tactical  bombing 
missions  per  unit  of  cost 

(d)  Expected  number  of  successful  reconnaissance 
missions  per  unit  of  cost 

(e)  Expected  number  of  successful  air  escort  missions 
per  unit  of  cost 


•  Transport 


•  Space  Launch  Vehicle 


(a)  Expected  number  of  consecutive  deliveries  of  speci¬ 
fied  cargo  to  its  destination  within  (x)  hours  per 
unit  of  cost  of  delivery 

(b)  Minimum  cost-time  product  required  to  deliver  a 
specified  cargo 

(c)  Expected  number  of  ton-miles  of  general  cargo 
transported  per  unit  of  cost 

(d)  Expected  number  of  consecutive  take-offs  and 
landings  in  (x)  distance  with  a  specified  gross 
weight  per  unit  of  cost  per  trip 


(a)  Expected  number  of  pounds  of  payload  placed  in  a 
specified  orbit  per  unit  of  cost 


♦Cost  normally  will  be  in  terms  of  dollars. 
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TABLE  3-S  EXAMPLES  OF  COST  EFFECTIVENESS  MEASURES  (Continued) 


•  Intercontinental  Ballistic  (a)  Minimum  cost  of  destroying  a  prescribed  target 

Missile  of  (x)  bardness  with  a  prescribed  probability 

(b)  Expected  number  of  targets  of  (x)  bardness 
destroyed  per  unit  of  cost 

(c)  Expected  dollar  value,  strategic  value,  or  percent 
of  damage  to  enemy  property  per  unit  of  cost 

•  Air  Interceptor  Missile  (a)  Expected  number  of  enemy  aircraft  destroyed  per 

unit  of  cost 

•  Air-to-Ground  Missile  (a)  Expected  number  of  targets  of  (x)  hardness 

destroyed  per  unit  of  cost 

(b)  Expected  level  of  damage  to  (m)  hardened  targets 
per  unit  of  cost 

(c)  Minimum  cost  required  to  destroy  (n)  or  more  of 
(m)  specified  targets 

•  Command  and  Control  (a)  Expected  number  of  stored  bits  of  information  re¬ 

trieved  within  a  specified  time  and  probability  per 
unit  of  cost 

(b)  Expected  number  of  intercepts  or  track -hours  of 
friendly  aircraft  per  unit  of  cost  given  a  specified 
level  of  enemy  activity 

(c)  Expected  number  of  intercepts  or  track -hours  of 
enemy  aircraft  per  unit  of  eo3t 

•  Warning  and  Detection  (a)  Minimum  cost  of  detecting  and  tracking  an  object 

with  a  specified  probability 

(b)  Expected  number  of  track -hours  with  a  specified 

_ _ accuracy  of  track  per  unit  of  cost _ 

*Cost  normally  will  be  in  terms  of  dollars. 
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In  formulating  the  cost  models ,  special  emphasis  should  be  given  to  insure  that  the 
models  have  the  capability  to  accommodate  the  following: 

•  Inclusive  identification  of  cost  by  categories,  including  the  nature  of  historical 
data  to  be  vsed  as  a  basis  for  projecting  cost.  A  guideline  for  a  typical  break¬ 
down  of  development  costs,  acquisition  costs,  and  operational  costs  by 
categories  is  presented  in  Table  3-9. 

•  Estimation  of  total  and  .per  year  cost  by  broad  aggregations.  Thus,  it  is 
expected  that  cost  estimates  below  the  categories  listed  in  Table  3-9  will  be 
required  only  in  the  special  case  where  sufficient  design  or  operational 
details  are  available 

•  Estimation  of  total  cost  on  a  basis  suitable  for  use  in  guiding  Air  Force 
system  selection  decisions. 

•  Cost  sensitivity  and  variance  analysis  to  provide  a  perspective  of  the  pre¬ 
cision  of  the  cost  estimates  and  to  assess  the  influences  of  cost  uncertainties. 
A  procedure  based  on  a  cost  variance  concept  or  a  PERT -cost  analysis  of 
least  possible,  expected,  and  maximum  possible  cost  can  be  applied  to  extrap¬ 
olations  of  historical  data  from  similar  or  related  systems. 


Procedure 

lie  procedure  for  the  technical  accomplishment  ci  the  model  structuring  step  can  be 
summarized  by  the  following  general  activities: 

•  List  major  assumptions  used,  including  their  solicit  rationale  and  justifi¬ 
cation 

•  Select  and  define  the  significant  states  which  are  to  be  incorporated  into  each 
effectiveness  parameter  model.  For  simplicity,  use  a  two-stage  analysis 

•  Represent  graphically  the  progression  of  the  system  from  state  to  state  for 
the  time  periods  of  the  mission 

•  Determine  probabilities  for  each  of  the  defined  states  which  are  appropriate 
at  the  beginning  and  during  the  mission 
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TABLE  3-9  EXAMPLES  OF  COST  CATEGORIES*  FOR 
COST  EFFECTIVENESS  ANALYSTS 


Development  Costs  (RDT  &  E) 

«  CFP  and  CDP  studies 

•  Development  of  each  stage  and 
*  subsystem  of  system 

9  AGE  development 

•  Training  equipment  development 

•  Test  program  and  test  articles, 

including  spares.  AGE,  and 
operational  test  personnel 
training 

•  Configuration  management 

•  Technical  data 

Acquisition  Costs 

•  Purchase  and  rework  of  major 

manufacturing  facilities 

•  Purchase  of  hard  tooling 

•  Purchase  of  new  basic  facilities 

•  Transportation  and  delivery  of 

systems 

•  Purchase  of  information  network 

facilities 

•  Purchase  of  depots  and  logistics 

support  bases 

a  Production  of  ancillary  equipment 

•  Purchase  of  initial  spares 

•  Training  equipment 

•  Technical  data 

•  Modifications  of  systems 

•  Stage  and  subsystem  production 

(including  AGE  &  OGE) 


Operational  Couta 

•  Materials  for  operations  and 

turnaround 

•  Operating  personnel 

•  Training  exercises  and  aids 

•  Spares  replenishment 

•  Depot  and  base  operations  and 

maintenance 

•  Equipment  maintenance 


♦For  some  applications,  it  may  be 
necessary  to  further  divide  the 
cost  categories  into  recurring  and 
non-recurring  costs,  direct  and 
indirect  costs,  or  any  combination 
thereof.  Also,  depending  on  the 
depth  of  Concept  Formulation  studies 
and  of  the  technological  advances  in¬ 
volved,  a  combining  of  the  listed  cost 
categories  may  be  more  appropriate 
for  the  cost  analyses. 


•  Define  and  formulate  models  for  the  availability,  dependability,  and 
capability  effectiveness  parameters  to  be  used  in  the  evaluation  of  each 
preliminary  FOM.  Each  model  normally  will  be  a  composite  of  submodels 
for  its  appropriate  critical  system  performance  parameters  previously 
identified,  defined,  and  functionally  related  to  critical  accountable  factors 
in  Step  E5. 

•  Group  threats  into  distinct  levels . 

•  Integrate  the  availability,  dependability,  and  capability  parameter  sets  into 
an  overall  system  effectiveness  model  which  can  be  used  to  calculate  an 
FOM.  Where  more  than  one  preliminary  FOM  is  applicable,  a  separate 
overall  model  will  be  required  to  evaluate  each  FOM 

•  Determine  the  feasibility  of  combining  FOMs.  If  technical  meaning  can  be 
attached  to  a  combined  measure,  then  establish  a  method  for  combining 
multiple  FOMs 

•  Define  and  structure  cost  effectiveness  model.  Define  system  concept 
selection  criteria  (criterion) 

•  Define  cost  measure.  Identify  significant  cost  resources  and  constraints 

•  Develop  cost  relationships.  Also  formulate  a  cost  model  for  each  FOM  with 
the  capacity  to  accommodate  estimates  of  total  and  per  year  costs  by  broad 
aggregations  and  cost  sensitivity  and  variance  analysis 

Information  Flow 

The  basic  data  required  for  die  model  structuring  activity  are: 

•  The  results  of  the  mission  analysis  activity  of  Step  El  for  the  identification  of 
the  applicable  mission  states  and  the  establishment  of  the  analysis  framework 
for  multiple  threats 

•  The  defined  FOMs  from  the  specifying  of  preliminary  FOM  activity  of  Step  E2 

•  The  results  of  the  effectiveness  parameter  selection  activity  of  Step  E5 
which  established  the  critical  system  parameters  to  be  included  in  the  avail¬ 
ability,  dependability,  and  capability  models 
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•  The  ROC,  RAO,  and  program  task  statements  for  determining  the  technical 
performance  and  cost  constraints,  and  for  a  selection  criterion  which  may  be 
included 

•  Cost  data  from  cost  analyses , 


The  effectiveness  parameter  models  and  overall  system  FOM  models  formulated  from 
the  model  structuring  activity  will  be  used  for  the  system  and  cost  effectiveness  analysis 
to  determine  the  system  performance  and  cost  potentials  with  respect  to  each  defined 
FOM,  and  to  a  combined,  single  FOM,  if  appropriate.  Figure  3-8  shows  the  basic 
information  network  for  this  activity. 


3-8  SYSTEM  AND  COST  EFFECTIVENESS  ANALYSIS 


STEP  E7 


General 

The  principal  use  of  the  models  for  system  effectiveness,  cost  ,  and  cost  effectiveness 
developed  in  the  previous  step  of  the  effectiveness  process  is  to  provide  an  estimate  of 
current  effectiveness  and  a  prediction  of  the  effectiveness  growth  potential  expected  to 
be  present  in  five  years.  These  estimates  are  directly  usable  to: 

•  Provide  a  timely  and  objective  management  decision  criterion  for  the 
selection  of  the  preferred  system 

•  Highlight  technical  and  cost  weaknesses  of  the  system,  or  potential  problem 
areas  requiring  resolution  during  later  phases 

•  Justify  proceeding  with  the  Contract  Definition  Phase  and  subsequent 
engineering  development 

•  Provide  the  initial  traceability  of  critical  system  performance  parameters 
to  preliminary  design  requirements , 


A  system  and  cost  effectiveness  analysis  is  an  iterative,  trade-off  process  involving  the 
use  of  optimization  techniques  to  arrive  at  a  design  concept  with  the  best  balance  of 
technical  performance  and  total  life  cycle  costs  to  meet  mission  objectives.  Simple 
optimization  techniques  which  have  general  and  practical  applicability  during  Concept 
Formulation  include: 

•  Simple  maximization  method.  This  technique  is  applicable  when  the  accountable 
factors  must  be  restricted  to  a  limited  range  of  candidate  values .  The  FOM  is 
evaluated  for  each  value  in  the  range  of  alternate  values  for  each  accountable 
factor 
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•  Method  of  steepest  ascent.  This  technique  is  applicable  when  the  FOM  depends 
in  a  linear  or  otherwise  simple  analytical  form  on  its  accountable  factors.  Alter¬ 
nate  values  for  the  accountable  factors  are  chosen  so  as  to  increase  the  FOM  in 
steps  which  are  as  large  as  possible. 

•  Graphical  method.  This  technique  is  applicable  if  the  transfer  functions  and 
constraints  are  based  on  empirical  data  or  curves. 

Evaluation  of  FQMs  and  Cost  Effectiveness 

The  evaluation  of  the  current  effectiveness  potential  of  each  system  concept  Involves  com¬ 
puting  the  FOMs  based  on  calculated  values  for  the  availability,  dependability,  and  capa¬ 
bility  parameters.  A  preliminary  design  is  chosen  by  repetitive  analyses.  Each  of  the 
performance  and  cost  alternatives  is  analyzed,  and  the  results  are  compared  with  a 
previous  choice.  This  process  is  inherently  difficult  since  it  involves  choosing  an  optimum 
value  for  many  system  parameters,  each  of  which  is  affected  by  numerous  accountable 

'  'N 

factors  with  different  inputs.  The  synthesis  method  for  speeding  this  trial  and  error  selec¬ 
tion  process  with  an  orderly  and  systematic  solution,  in  addition  to  providing  considerable 
insight  into  the  design  problem,  has  been  described  in  Step  E5.  In  using  this  method,  sys¬ 
tem  developers  will  have  visibility  of  how  the  input,  output,  and  system  functional  character¬ 
istics  are  connected,  what  sensitivities  are  best,  and  the  limitations  of  the  system  perform¬ 
ance  capabilities. 

While  the  system  developers  will  have  the  freedom  to  adjust  the  system  parameters  and 
accountable  factors  to  their  best  values  and  for  best  cost,  there  remains  the  problem  of 
determining  which  combination  will  provide  the  optimum  system  and  cost  effectiveness. 

A  practical  method  for  providing  this  perspective  is  to  develop  sensitivity  functions  which 
will  directly  relate  incremental  changes  in  critical  accountable  factors  to  a  corresponding 
magnitude  and  direction  of  change  in  the  FOMs.  This  form  of  sensitivity  functions  may  be 
generated  directly.  Alternately,  it  may  be  developed  by  combining  the  sensitivity  functions 
previously  prepared,  which  related  the  accountable  factors  to  effectiveness  parameters, 
with  a  sensitivity  function  relating  the  set  of  effectiveness  parameters  to  each  FOM.  The 
general  procedure  for  arriving  at  this  combined  sensitivity  function  for  an  FOM  is  de¬ 
scribed  in  Appendix  C.  Based  upon  such  relationships,  the  preliminary  criticality  matrix 
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initially  formulated  in  Step  ES  can  be  updated,  and  the  ranking  and  the  index  of  relative 
criticality  of  accountable  factors  to  the  effectiveness  parameters  and  the  FOM  revised. 

With  the  cost  effectiveness  optimisation  of  a  system  concept  and  a  determination  of  its 
current  FOM  potential,  an  optimum  system  effectiveness  value  will  be  obtained.  Due 
to  the  statistical  distribution  properties  of  the  accountable  factors,  the  FOM  is  a 
distribution  of  values.  If  each  accountable  factor  influences  its  FOM  independent  of 
another  accountable  factor,  then  an  estimate  of  the  variance  for  the  FOM  can  be  obtained 
simply.  This  variance  will  be  the  sum  of  the  variances  for  the  individual  accountable 
factors.  In  addition  to  the  best  estimate,  a  lower  confidence  estimate  can  be  prepared 
to  account  for  inherent  statistical  risks.  Also,  an  estimate  of  the  error  range  to  be 
associated  with  the  uncertainties  of  critical  model  assumptions  can  be  calculated. 

Analyses  Required 

The  goal  of  system  and  cost  effectiveness  evaluations  during  Concept  Formulation  is  to 
provide  specific  outputs  usable  for  management  decisions.  Interim  analysis  results 
provide  Air  Force  and  contractor  management  with  the  necessary  visibility  for  creating 
the  best  system  concept,  given  the  technical  and  other  resources  at  their  disposal. 
Correspondingly,  the  final  analysis  results  provide  criteria  for  Air  Force  management 
decisions  on  the  preferred  system  concepts)  to  select.  Additionally,  they  contribute 
to  the  necessary  technical  and  cost  justifications  for  proceeding  with  subsequent  phases 
of  the  program. 

Standardization  of  a  desired  set  of  analytical  outputs  la  necessary  to  insure  an  objec¬ 
tively  candid  and  compatible  Air  Force  evaluation  of  the  candidate  systems.  As  a 
minimum,  therefore,  the  system  and  cost  effectiveness  analysis  activity  is  to  be  directed 
at  providing  current  and  predicted  estimates  of  the  performance  and  cost  characteristics 
of  the  candidate  system  concepts.  Measures  to  be  evaluated  during  Concept  Formu¬ 
lation  are: 

•  FOMs 

•  Cost  effectiveness 

•  Availability 
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•  Dependability 

•  Capability 

•  Each  critical  system  parameter  constituting  the  availability,  dependability, 
and  capability  parameters 

To  the  extent  possible,  both  a  mean  estimate  and  a  lower  confidence  estimate  is  to  be 
provided  for  these  measures,  along  with  the  expected  error  range  for  both  types  of 
estimates.  The  principal  uses  in  the  decision  process  of  these  estimates  resulting  from 
the  effectiveness  analyses  are  listed  in  Table  3-10.  Also  listed  are  examples  of 
measurement  units  which  will  require  designation  prior  to  any  evaluation  of  system  and 
cost  effectiveness  for  concept  comparison  purposes. 

A  decision  is  required  as  to  how  to  optimize  for  multiple  missions  for  which  different 
preliminary  FOMs  have  been  defined.  Usually  one  of  the  following  rules  can  be  applied 
as  a  compromise: 

•  Optimize  to  the  most  significant  FOM  (difficult,  primary,  etc. )  subject  to  meeting 
minimum  performance  on  the  balance  of  the  FOMs. 

•  Optimize  to  improve  the  lowest  FOM  value. 

•  Optimize  to  an  average  or  weighted  average  FOM,  where  such  a  measure  has  an 
operational  physical  parallel. 


Procedure 

The  procedure  for  the  technical  accomplishment  of  the  system  and  cost  effectiveness 
analysis  step  can  be  summarized  by  the  following  general  activities: 

•  Identify  the  vital  trade-off  factors  available  within  constraints ,  to  include  alter¬ 
natives  for  critical  system  parameters,  critical  accountable  factors,  and  cost 
elements. 

•  Determine  values  of  accountable  factor  which  will  maximize  the  effectiveness 
parameters,  using  the  sensitivity  functions  developed  in  Step  E5.  An  accountable 
factor  which  influences  more  than  one  parameter  will  require  a  composite 
optimization  at  the  overall  FOM  level. 
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j  TABLE  3-10  MINIMUM  ANALYSES  REQUIRED  AND  PRINCIPAL  USES 


Analysis 

Unit  of  Measure 

Principal  Use 

• 

System 

Effectiveness 

(FOMs) 

Probability  or  expected 
value 

Measure  of  overall  technical 
performance  and  response  to 
mission  objectives. 

System  selection  criterion  and 
justification. 

• 

Cost 

Effectiveness 

System  effectiveness  per 
cost 

Dollar  value  per  cost 

Dollar  value 

System  effectiveness  per 
unit  time  per  cost 

Measure  of  overall  technical 
and  cost  performance  and 
response  to  mission  objectives. 

System  selection  criterion  and 
justification. 

• 

Availability 

Probability  or  expected  value 
as  a  function  of  total  turn¬ 
around  time 

In- commission  ready  rate 
Utilization  rate 

Measure  of  system  condition  at 
start  of  mission. 

Provide  intelligence  on  potential 
operational  problem  areas  and 
traceability  of  preliminary 
dasign  requirements. 

• 

Dependability 

Probability  or  expected 
value  as  a  function  of  mission 
time,  failure  rate,  in-mission 
repair  rate,  alternate  modes 
of  operation,  reaction  time, 
and  dispersal  distance 

Measure  of  system  condition  at 
one  or  more  points  during  mission, 
given  the  system  condi tion(s) 
at  the  star  t  of  the  mission. 

Provide  intelligence  on  potential 
reliability  and  survivability 
problem  areas  and  traceability 
of  preliminary  design  requirements. 

• 

Capability 

Probability  or  expected 
value 

Measure  of  system  ability  to 
achieve  mission  objectives. 

Provides  intelligence  on  potential 
general  limitations  of  system's 
performance  capabilities,  problem 
areas,  and  traceability  of 
preliminary  design  requirements. 

• 

Critical  System 
Parameters 

Probability  or  expected 
value 

Individual  measure  of  each  critical 
performance  capability  or  character¬ 
istic  of  system. 

Provides  intelligence  on  potential 
design  problem  areas,  safety  margins, 
and  traceability  of  preliminary 
design  requirements. 


Develop  a  sensitivity  function  to  relate  incremental  changes  in  the  values 
of  accountable  factors  to  changes  in  an  FOM. 


•  Calculate  the  FOMs  based  on  the  accountable  factor  values  and  using  the  FOM 
models  developed  in  Step  E6. 

•  Calculate  the  cost  associated  with  the  selected  alternatives. 

•  Optimize  the  FOM  and  cost  interactions,  and  calculate  the  cost  effectiveness 
measure,  using  the  model  defined  and  developed  in  Step  £6. 

•  Calculate  a  lower  confidence  estimate  for  each  FOM  based  upon  statistical 
distribution  principles. 

•  Update  the  preliminary  criticality  matrix  prepared  in  Step  E5. 

•  Compute  a  confidence  estimate  for  the  cost  effectiveness  measure,  using 
statistical  distribution  principles  and  a  cost  variance  analysis  technique. 

•  Compute  an  error  range  for  the  FOM  and  cost  effectiveness  estimates  to 
account  for  assumption  errors. 

•  Tabulate  for  each  mission,  and  for  the  most  probable  and  worst  threat  levels, 
the  current  and  predicted  (for  a  period  of  time  five  years  hence)  values  for  the 
FOM  and  cost  effectiveness  measures,  the  availability,  dependability,  and 
capability  parameters,  and  the  critical  system  parameters, 

•  Compare  candidate  system  concepts  with  respect  to  all  these  classes  of 
estimates  for  intelligence  as  to  the  concept  to  select. 

Information  Flow 

The  basic  data  required  for  the  system  and  cost  effectiveness  analysis  activity  are: 

•  The  alternate  functions  and  their  associated  performance  parameters  and 
accountable  factors,  and  the  candidate  range  of  values  for  the  critical  accountable 
factors.  These  were  identified  in  Step  EG  with  significant  inputs  from  the  Develop 
Gross  Functions  and  Determine  Design  Requirements  activities  of  the  systems 
engineering  process  defined  in  AFSCM  375-5. 


•  The  models,  model  assumptions,  technical  performance  and  cost  constraints, 
and  optimization  criteria  from  the  model  structuring  activity  of  Step  E6. 

•  The  cost  data  for  the  various  alternatives. 

•  The  sensitivity  functions  and  criticality  matrices  from  the  effectiveness  param¬ 
eter  selection  activity  of  Step  ES. 

The  principal  uses  of  the  analysis  results  are  as  previously  delineated  in  Table  3-10. 
Additionally,  the  analysis  results  are  to  be  incorporated  into  a  report  which  summarizes 
the  major  outputs  of  the  system  and  cost  effectiveness  management  implementation  process 
developed  during  Concept  Formulation.  The  basic  information  network  for  the  system  and 
cost  effectiveness  analysis  step  is  shown  in  Figure  3-9. 
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STEP  E8 


General 

A  report  is  to  be  prepared  and  submitted  to  the  Air  Force  technical  activity  summarizing 
the  system  and  cost  effectiveness  formulation  and  evaluation  results  for  the  Concept 
Formulation  Phase.  The  technical  data  to  be  included  in  this  report  will  serve  many  vital 
needs  of  the  system  planners  at  HQ  USAF,  HQ  AF3C,  and  the  SPO  cadre.  Of  dominant 
relevance  are  the  foUowinganticipated  uses  of  the  data: 

•  To  provide  the  justification  for  a  new  system,  and  to  demonstrate  that  the  six 
prerequisites  required  for  conditional  approval  to  proceed  with  engineering 
development  have  been  met.  These  prerequisites  are  described  in  AFR  80-20  and  are 
listed  in  paragraph  3-1  of  this  manual. 

•  To  provide  a  decision  criteria  for  Air  Force  selection  of  the  most  promising  candi¬ 
date  system  concepts)  to  meet  current  and  contingent  mission  objectives,  including 
strike,  retaliatory,  and  defense  capabilities. 

•  To  have  available  realistic  data  for  updating  and  refining  the  RAD,  and  for  establish¬ 
ing  the  program  baseline  requirements  as  part  of  the  planning  process  for  entering 
the  Contract  Definition  Phase. 
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•  To  have  valid  inputs  of  system  performance  and  cost  characteristics  for 
inclusion  into  the  CFP/TDP  and  the  Preliminary  Definition  Plan  to  be  prepared 
at  the  conclusion  of  Concept  Formulation. 

•  To  provide  the  necessary  background  and  continuity  for  the  related  technical 
activities  of  the  Contract  Definition  and  Acquisition  Phases  on  the  traceability 

of  preliminary  design  requirements  and  the  areas  of  system  and  cost  effectiveness 
criteria  formulation  and  evaluation  requiring  expansion  and  refinement. 

•  To  focus  the  inherently  critical  design  and  operational  problems  and  limitations 
requiring  further  definition,  detail  analysis,  and  resolution  in  latei  phases. 

These  include  those  areas  of  high  technical  risk,  high  cost,  and  insufficient  prior 
analysis. 

The  system  and  cost  effectiveness  report  is  to  ino’ude  the  following  technical  data: 

•  An  explicit  definition  and  description  of  the  preliminary  FOMs,  to  include  mission 
conditions  which  apply. 

•  An  explicit  definition  of  the  cost  effectiveness  measure. 

•  Analysis  results  giving  current  and  predicted  estimates  of  FOMs,  cost  effective¬ 
ness  measures,  effectiveness  parameters  of  availability,  dependability,  and 
capability,  and  each  critical  system  parameter  constituting  the  effectiveness 
parameter  sets  (e.g. ,  reliability,  maintainability,  accuracy,  etc.).  Estimates 
are  to  be  tabulated  by  separate  FOMs,  cost  effectiveness  measures,  and  threat 
levels,  as  applicable.  The  precision  of  the  estimates  is  to  be  furnished. 

•  Mission  analysis  results,  including: 

(1)  A  general  description  of  the  intended  purposes  and  functions  of  the  system 

(2)  Summaries,  descriptions,  and  analyses  of  enemy  threats,  enemy  counter¬ 
measures,  and  system  neutralizing  capabilities 

(3)  Interactions  of  mission  requirements  with  existing  systems  or  systems 
contemplated  to  be  in  use  within  the  same  time  frame 

•  System  performance  requirements  profile,  including  parameters  and  values 
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•  System  operational  requirements  analyses  relating  to: 

(1)  Operational  requirements  profile,  including  parameters  and  values 

(2)  Maintenance  concept  under  hostile  conditions,  such  as  capabilities  for 
repair  of  battle  damage  and  for  over-ride  and  temporary  correction  of 
malfunctions  under  hostile  conditions 

(3)  Logistics  support  concept,  including  maintenance  policy  and  transportability 

(4)  Concept  of  practice  exercises  for  maintaining  system  readiness  state 

•  Current  and  projected  technical  and  cost  deficiencies  influencing  effectiveness 

•  Criticality  matrix,  to  include  relative  rankings  of  system  parameters  and 
accountable  factors 

•  Models  and  submodels  used  in  the  evaluation  of  FOMs,  cost  effectiveness  measures, 
and  effectiveness  parameters,  including  descriptions  and  listings  of: 

(1)  Major  assumptions  and  their  criticality 

(2)  Transfer  functions  used  in  the  evaluation  of  the  critical  system  parameters 

(3)  System  states  and  probabilities  assigned 

(4)  Threat  level 

(5)  Major  performance  and  cost  alternatives  considered 

•  Sensitivity  functions  (or  curves)  relating  the  critical  accountable  factors  to 
FOMs  or  to  the  effectiveness  parameters 

•  Data  sources  used  in  the  analyses 

•  Cost  data  and  cost  basis  used  for  the  evaluation  of  cost  effectiveness. 
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Information  Flow 

All  of  the  major  criteria  formulation  and  evaluation  activities  of  the  effectiveness 
process,  Steps  El  -  E7,  will  provide  inputs  to  the  report,  with  reciprocating  con¬ 
tributions  from  the  systems  engineering  management  activities  of  Develop  Gross 
Functions  and  Determine  Design  Requirements  as  defined  in  AFSCM  375-5.  The 
technical  data  incorporated  in  the  report  are  directly  usable  for  updating  the  RAD 
and  for  the  preparation  of  the  Preliminary  CFP/TDP  and  Definition  Plan  documents. 
These  documents  are  an  integral  part  of  the  program  requirements  baseline  needed 
to  commence  Contract  Definition.  The  basic  information  network  for  the  report 
activity  of  the  effectiveness  process  is  shown  in  Figure  3-10. 
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Chapter  4 


SYSTEM  AND  COST  EFFECTIVENESS  IMPLEMENTATION 
FOR  CONTRACT  DEFINITION  PHASE 


Summary 

The  major  effectiveness  formulation  and  evaluation  activities  to  be  accomplished 
during  the  Contract  Definition  Phase  are  (1)  effectiveness  analysis  refinement, 

(2)  apportionment  analysis,  (3)  effectiveness  progress  monitoring  and  demonstra¬ 
tion  planning,  and  (4)  report  of  analytical  results.  The  effectiveness  analysis  re¬ 
finement  activity  is  addressed  to  the  necessary  improvement  and  expansion  of  the 
technical  analysis  activities  initiated  on  a  gross  basis  during  Concept  Formulation 
for  the  system  being  defined  in  detail.  The  apportionment  analysis  activity  is  di¬ 
rected  at  the  establishment  of  design  criteria  which  are  technically  traceable  and 
critical  to  system  effectiveness  for  inclusion  in  system  and  detail  specifications. 
This  is  accomplished  through  the  optimum  allocation  of  top-level  effectiveness- 
related  measures  and  parameter  values  to  first-level  measures  and  contributing 
accountable  factors.  The  activity  of  effectiveness  progress  monitoring  and  demon¬ 
stration  planning  focuses  on  the  definition  of  a  dynamic  monitoring  and  evaluation 
program  and  a  demonstration  program.  These  programs  collectively  will  provide 
a  continuing  visibility  of  effectiveness  progress  so  that  timely  management  deci¬ 
sions  can  be  made  to  insure  achievement  of  an  optimum  balance  of  performance, 
cost,  and  schedule.  The  report  activity  provides  the  SPO  with  a  compendium  of  the 
analytical  results  and  decisions  influencing  effectiveness  which  are  needed  to  pre¬ 
pare  the  baseline  documents  for  the  Acquisition  decision.  The  basic  manual  format 
used  to  describe  the  effectiveness  process  during  Concept  Formulation  is  continued 
for  this  phase.  The  general  descriptions  of  procedures  and  methods  which  can  be 
applied,  implementation  guidelines,  and  the  information  flow  are  delineated  on  a 
step-by-step  basis.  The  interactions  of  the  effectiveness  activities  with  the  sys¬ 
tem  program  management  procedures  of  AFSCM  375-4  on  a  composited  basis  also 
are  detailed. 


4-1  GENERAL 


The  Contract  Definition  Phase  is  a  sequential  action  process  on  a  time  basis,  as 
was  characteristic  of  the  Conceptual  Phase.  The  purpose  of  the  Definition  Phase  is 
to  define  as  early  as  possible  the  cost  schedule,  and  system  elements  required  to 
satisfy  the  approved  CFP/TDP,  RAD,  and  other  program  directives  and  baseline 
requirements  issued  by  HQ  USAF  to  direct  this  phase  of  the  system  project.  The 
Definition  Phase  is  intended  to  achieve  specific  objectives.  These  are: 

(a)  Effective  use  of  defense  resources. 

(b)  Preparation  of  the  System  Performance /Design  Requirements 
General  Specification  (the  "System  Specification"). 

(c)  Preparation  of  detailed  program  management  plans. 

(d)  Determination  of  realistic  cost  and  schedule  estimates.  The  schedules 
and  cost  estimates  will  reflect  requirements  for  production  engineering, 
facilities,  transportation,  construction,  logistic  support,  and  production 
hardware,  as  well  as  development  engineering.  Planning  cost  and  schedule 
estimates  for  investment  and  for  operating  the  system  for  5  years  will  be 
included. 

(e)  Identification  of  high-risk  areas. 

(f)  Definition  of  inter  system  and  intrasystem  interfaces  and  corresponding 
responsibilities . 

(g)  Evaluation  of  time  -  cost- pe  rf o  rm  ance  trade-offs. 

(h)  Determination  of  firm  and  achievable  Part  I  CEI  Detail  Specifications  and 
Inventory  Equipment  Requirement  Specifications. 

(i )  Validation  of  the  technical  approach  for  the  total  system  cost  which  will 
lead  to  the  formalized  firm  fixed-price  (FFP),  fixed-price  incentive  (FPI), 
or  cost-plus-incentive-fee  (CPIF)  contract  for  the  design  and  development 
portion  of  the  Acquisition  Phase. 

(j)  Identification  of  personnel  and  training  requirements. 

(k)  Identification  of  the  procedural  data  required. 
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The  technical  activities  of  the  effectiveness  process  to  be  implemented  during  this 
phase  will  contribute  directly  towards  achieving  objectives  (a),  (b),  (e),  (f ),  (g), 
(h),  (i),  and  (k),  and  indirectly  towards  (c),  (d),  and  (j). 


Application  of  the  system  and  cost  effectiveness  technology  during  Contract  Definition 
will  provide  the  initial  penetrating  analysis  of  the  inherent  effectiveness  potentials 
present  in  the  selected  weapon,  support,  or  electronic  system  concepts) .  Effective¬ 
ness  analyses  to  be  accomplished  will  shape  design  solutions  for  achieving  the  optimum 
balance  of  time,  cost,  and  performance.  Additionally,  they  will  provide  a  detail 
management  focus  of  the  performance  proficiency  and  economy  of  the  system  configu¬ 
ration  by  identifying  the  specific  high  technical  and  cost  risk  areas  requiring  further 
exploration,  the  system  and  subsystem  performance  and  design  parameters  to  be 
included  in  specifications,  and  the  critical  system  parameters  to  be  tracked  and 
demonstrated  during  Acquisition.  In  general,  the  following  implementation  steps 
summarize  the  activities  of  the  effectiveness  criteria  formulation,  evaluation,  and 
assurance  process  required  during  the  Contract  Definition  Phase  to  provide  this 
authoritative  perspective: 


•  |  Step  E9  -  Effectiveness  Analysis  Refinement  |  This  activity  is  directed 
at  refining  and  extending  the  system  and  cost  effectiveness  activities 
previously  initiated  on  a  gross  basis  in  the  Concept  Formulation  Phase. 


|  Step  E10  -  Apportionment  Analysis^  This  activity  establishes  the 
technical  definition  and  traceability  of  the  system  performance  and  design 
requirements  and  subsystem  allocations  to  be  included  in  the  System 
Performance /Design  Requirements  General  Specification  and  the  major 
Contract  End  Item  (CEI)  detailed  specifications  prepared  and  issued  during 
this  phase. 

Step  Ell  -  Effectiveness  Progress  Monitoring  and  Demonstration  Planning] 

This  activity  establishes  the  essential  system  performance  parameters  and 
their  expected  convergence  profile  which  are  to  be  tracked  during  Acquisition 
as  a  fundamental  effort  of  a  Technical  Performance  Measurement  program 
to  determine  the  impact  to  the  principal  FOMs  of  variances  in  their  values 
from  planned  values.  As  a  related  task,  this  activity  defines  the  demon¬ 
stration  approach  and  die  parameters  to  be  demonstrated  as  evidence  of  the 
achievement  of  the  FOMs  during  the  Category  I,  EL,  and  III  testing  and  Technical 
Approval  Demonstrations  (TADs)  to  be  conducted  in  the  Acquisition  and 
Operational  Phases. 
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•  (step  E12  -  Reporting^  This  activity  provide*  the  compendium  of  the 

system  and  cost  effectiveness  criteria  formulation,  evaluation,  and 
assurance  results  during  the  Contract  Definition  Phase  to  be  Included  in 
the  Proposed  System  Package  Program  (PSPP)  document  upon  synthesis 
by  the  SPO  of  the  best  features  of  each  design  approach  into  an  optlmumly 
operable  and  economical  system. 

The  degree  that  system  and  cost  effectiveness  requirements  are  to  apply  during 
the  Definition  Phase  will  be  specifically  set  forth  in  the  CFP/TDP  or  Statement  of 
Work  (SOW)  baseline  requirements  documents.  Typical  requirements  include: 

e  Establishment  of  the  principal  FOMs  and  their  numerical  values,  if  not 
provided  in  the  RAD,  System  Performance  /Design  Requirements  General 
Specification,  or  CFP/TDP.  The  principal  FOMs  are  to  be  hilly  responsive 
measures  of  system  performance  with  respect  to  the  total  set  of  mission 
objectives,  hi  contrast,  the  preliminary  FOMs  established  during  Concept 
Formulation  may  have  related  only  to  specific  subsets  of  the  mission 
objectives.  Such  special  purpose  FOMs  were  useful  as  comparative 
criteria  for  distinguishing  unique  capabilities  of  the  candidate  system 
concepts,  and  for  establishing  their  feasibility. 

•  Implementation  of  updated  system  effectiveness  analyses  to  include  analysis 
of  the  availability,  dependability,  and  capability  effectiveness  parameters, 
specifically  accounting  for  various  significant  system  states  and  critical 
factors  of  influence. 

•  Implementation  of  updated  cost  analyses  to  include  developmental, 
acquisition,  operational,  and  maintenance  costs  in  relation  to  system 
development  and  acquisition  schedules. 

•  Implementation  of  a  refined,  composite  cost  effectiveness  analysis  to  obtain 
an  optimum  balance  of  technical  performance,  cost,  and  schedule  time. 

•  Apportionment  of  the  principal  FOMs  and  the  constituent  system  parameters 
which  make  up  the  availability,  dependability,  and  capability  effectiveness 
parameter  sets. 

•  Reporting  of  analysis  results,  progress  monitoring  planning,  and  demon¬ 
stration  planning,  with  supporting  data. 
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These  typical  requirements  presume  the  existence  of  formalized  effectiveness 
criteria  formulation  and  evaluation  results  from  previous  activities  of  the  Concept 
Formulation  Phase.  However,  prior  results  are  not  a  prerequisite  for  procurement 
situations  where  it  is  expendient  or  judicious  to  defer  full  implementation  of  the 
effectiveness  technology  to  the  Contract  Definition  Phase  (e.g.,  due  to  the  immediacy 
of  the  program  or  insufficient  definition  during  Concept  Formulation). 

The  system  and  cost  effectiveness  activities  to  be  implemented  during  Contract 
Definition  is  characterized  by  a  continuous  refinement  and  expansion  of  the  initial, 
summary  "level  criteria  formulation  and  evaluation  elements  of  the  Concept 
Formulation  Phase  to  first  and  second  system  indenture  levels  on  the  preferred 
concepts  selected  for  detail  definition.  This  is  a  natural  companion  to  the  refinement 
and  updating  of  design  and  performance  details  and  definition  which  are  progressively 
and  concurrently  accomplished  under  the  system  program  management  and  systems 
engineering  management  processes  during  this  phase.  Both  of  these  processes  are 
evolutionary  in  nature  and  are  represented  in  AFSCM  375-4  and  375-5,  respectively, 
as  a  sequential  series  of  finely-divided  technical  and  management  activities, 
typically  iterated  in  part  in  each  of  the  three  subphases  of  Contract  Definition. 

To  provide  the  proper  technical  perspective  of  the  system  and  cost  effectiveness 
process  during  this  phase,  and  the  necessary  visibility  of  the  true  interactions  of 
the  three  processes,  a  composite  and  non-iterative  series  of  system  program 
management  and  systems  engineering  management  activities  has  been  defined.  These 
composite  activities,  representing  a  derivative  of  the  system  program  management 
process  of  AFSCM  375-4  only  {which,  in  itself,  already  is  a  first  order  integration 
of  the  more  detail  systems  engineering  management  network  and  other  program 
networks),  are: 

•  Establishment  of  baseline  requirements,  including  trade-off  studies 
required  to  adequately  define  the  system  concepts 

•  Preparation  and  issue  of  the  specification  tree,  the  System  Performance/ 
Design  Requirements  General  Specification,  and  detail  specifications  on 
major  CEIs. 

•  Preparation  and  issue  of  the  program  work  breakdown  structure  (PBS). 
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•  Preparation  and  issue  of  the  SOW  and  Request  for  Proposal  (RFP)>  and 
updating  of  the  Definition  Plan. 

•  Review,  verification,  modification,  and  expansion  of  design  details  by 
selected  contractors  to  accommodate  their  design  approach,  including 
determination  of  detail  performance  and  design  requirements  for  operations, 
maintenance,  test,  and  activation  functions. 

•  Revision  and  expansion  by  the  SPO  and  contractors  of  functional  analyses. 
Requirements  Allocation  Sheets  (RASs),  Trade  study  Reports,  schematic 
diagrams,  time-line  sheets,  and  effectiveness  models. 

e  Preparation  and  issue  of  initial  test  plan. 

•  Establishment  of  detailed  end  item,  facility,  personnel,  and  training 
requirements. 

•  System  requirements  review,  technical  evaluation,  and  baseline  updating. 


4-2  EFB'ECTIVENESS  ANA  LYSIS  REFINEMENT  [  Step  E9  | 

General 

The  effectiveness  analysis  refinement  activity  is  addressed  to  the  refinement  and 
expansion  of  the  gross  results  obtained  in  implementation  Steps  E1-E7,  and 
documented  in  Step  E8  during  Concept  Formulation.  This  information  is  directly 
available  for  use  in  the  Definition  Phase  via  the  CFP/TDP,  RAD,  and  other  baseline 
documents  to  provide  direction  for  the  analyses  and  to  illuminate  areas  requiring 
emphasis  and  refinement.  Technical  results  and  analyses  that  normally  will 
require  updating  include  the  following: 

•  Mission  analysis 

•  Specifying  principal  FOMs 

•  Performance  requirements  analysis 

•  Operational  requirements  analysis 
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•  Effectiveness  parameter  selection 

•  Model  structuring 

•  System  and  cost  effectiveness  analysis 

The  nature  of  the  refinement  and  the  specific  extent,  timing,  and  areas  in  which  the 
refinements  are  to  be  accomplished  will  depend  on  the  exigencies  and  particular 
definition  needs  of  each  program. 

Mission  Analysis 

Descriptions  of  the  specific  objectives  of  the  mission  are  to  be  updated  to  reflect 
the  latest  information  on  the  terminal  performance  that  is  required  to  be  achieved 
by  the  system  under  ope:  vtional  conditions.  Correspondingly,  the  kinds,  magnitude, 
and  probability  of  occurrence  ox  enemy  threats  currently  expected,  and  projected 
to  be  present  in  the  five  year  future,  may  require  further  confirmation  and  definition. 
The  modifying  influences  of  specific  neutralizing  capabilities  of  the  system  against 
the  threats  or  combination  of  threats,  as  well  as  the  survival  requirements  under 
battle  and  peacetime  operational  levels  of  man-made  and  natural  environments, 
also  will  require  more  precise  definition  in  terms  of  prescribed  limitations.  These 
limitations  normally  are  to  be  prescribed  as  maximum,  minimum,  or  nominal  values, 
or  nominal  values  with  a  permissive  range  of  values. 

The  basic  sources  of  accrued  information  needed  to  obtain  the  detail  level  of 
definition  required  for  the  mission  analysis  activity  will  principally  be  the  updated 
RAD,  intelligence  studies,  system  planning  studies,  and  analyses  of  the  performance 
impact  of  complementary  systems  to  be  employed  in  conjunction  with  the  planned 
system,  as  described  in  the  baseline  CFP/TDP.  While  it  is  expected  that  the 
specific  mission  objectives  may  require  a  penetrating  reexamination  if  the  Conceptual 
studies  indicate  over-conservatism  or  over-optimism  of  specific  objectives,  it  also 
is  not  expected  that  the  mission  will  be  redefined  solely  to  be  compatible  with  the 
capabilities  of  the  preferred  systems.  Ey  maintaining  a  conservative,  but  acceptable, 
mission  objective  stance,  a  reduction  in  total  system  cost  can  be  anticipated. 
Correspondingly,  overly  optimistic  mission  objectives  can  be  achievable  by 
merging  capabilities  of  existing  systems  with  the  planned  new  system  as  one  of  the 
effective  operational  alternatives  available. 
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Ae  a  result  of  defining  in  greater  detail  and  in  a  more  quantitatively  precise  frame 
the  mission  objectives  and  operational  condition  under  which  the  objectives  are  to  be 
achieved,  the  principal  FOMs  can  be  accurately  formulated.  Furthermore,  an  ex¬ 
plicit  technical  correspondence  can  now  be  established  between  FOM  statements  a r  d 
specific  objective  requirements. 

Specifying  Principal  Figures  of  Merit  (FOMs) 

Principal  FOMs  are  to  be  developed  during  Contract  Definition  as  measures  of  the 
overall  performance  quality  of  the  system  being  defined  for  acquisition.  For  this 
purpose ,  the  principal  FOMs  are  to  be  directly  identifiable  with  the  total  set  of 
mission  objectives,  and  are  to  envelop  the  critical  and  measurable  top-level  per¬ 
formance  parameters  observable  in  the  system.  These  system  parameters  normally 
will  include  any  quantifiable  mission  requirements  (or  translation  of  requirements) 
which  may  describe  the  basic  capabilities  that  the  selected  system  is  to  possess. 

Major  baseline  decisions  are  required  in  formulating  the  principal  FOMs  during  the 
Contract  Definition  Phase,  including  the  following; 

•  Means  by  which  the  FOMs  are  to  be  responsive  to  the  technical  considerations 
of  multiple  missions.  Typical  responsive  approaches  to  this  aspect  of  the  FOM 
definition  problem  are  (1)  to  develop  an  overall  FOM  compositing  each 
system  FOM  or  (2)  to  establish  a  rank-order  of  the  FOMs  in  terms  of  their 
relative  importance. 

•  Mapping  by  which  a  technical  correspondence  can  be  established  between  each 
FOM  and  the  spectrum  of  critical  system  performance  parameter  which  it 
composites. 

•  Extent  to  which  the  principal  FOMs  are  to  be  quantitatively  and  descriptively 
apportioned  to  the  major  subsystems  to  accurately  represent  the  restrictive 
performance  contributions  of  each  major  subsystem  to  the  principal  FOMs. 


To  the  extent  practicable,  quantitative  values  for  each  defined  FOM  are  to  be  sj  ified 
in  the  system  specification,  and  included  in  the  RFP  to  guide  contractor  definition 
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activities.  The  value  to  be  sp  if  led  for  each  principal  FOM  defined  at  the  inception  of 
the  Definition  Phase  can  be  established  through  extrapolations  of  the  effectiveness  analy¬ 
sis  results  acquired  during  Concept  Formulation.  Each  principal  FOM  defined  and  FOM 
value  specified  will  require  a  re-examination  at  the  conclusion  of  Definition  Phase  studies 
for  possible  revision  prior  to  use  in  the  next  phase  of  Acquisition. 

Performance  Requirements  Analysis 

With  the  definition  of  the  principal  FOMs,  the  reassessment  of  mission  goals  and 
available  resources,  and  the  updating  and  detailing  of  the  system  operations  functions 
to  first  and  second  levels  by  the  systems  engineering  activities,  a  corresponding  ex¬ 
tension  is  required  of  the  set  of  time-based  tables  and  matrices  comprising  the  per¬ 
formance  requirements  profile.  The  definition  of  the  profile  should  be  sufficiently 
complete  to  provide  a  technical  mapping  of  each  principal  FOM  to  its  corresponding 
set  of  required  system  and  subsystem  functions  and  critical  design  performance 
parameters  to  be  associated  with  the  functions.  The  gross  system  performance  re¬ 
quirements  profile  available  from  the  Conceptual  studies  will  provide  visibility  of  the 
areas  requiring  further  detail  trade-off  studies  to  establish,  refine,  or  confirm  the 
critical  system  parameters  and  parameter  values  to  be  included.  The  updating  of  the 
profile  is  ar  iterative  process  for  the  purpose  of  providing  a  current  system  parameter 
reference  frame  for  the  effectiveness  parameter  selection,  model  structuring,  and 
effectiveness  analysis  activities  during  this  phase. 

The  basic  input  data  required  are  the  revised  and  expanded  (1)  time-lines,  (2)  func¬ 
tional  diagrams  depicting  system  requirements  in  functional  terms,  (3)  schematic 
diagrams  of  design  characteristics  within  and  between  each  subsystem,  (4)  RASs 
relating  functions  to  be  performed  by  the  system  to  the  design  requirements  which 
must  be  satisfied  to  meet  these  functions,  (5)  trade-off  study  reports  describing  the 
comparative  analysis  and  selection  of  alternative  design  approaches,  (6)  mission 
analysis  and  FOM  descriptions,  and  (7)  the  RAD  and  CFP/TDP  baseline  documents. 

The  primary  technical  contributions  of  the  performance  requirements  analytical  results 
are  to  provide  the  following; 

•  The  basic  technical  traceability  of  the  FOMs  to  system  and  subsystem  design 
a_id  performance  parameters 
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•  The  principal  benchmarks  and  reference  frame  for  the  updating  of  the 
dependability  and  capability  effectiveness  parameters,  models,  and  effec¬ 
tiveness  analyses. 

•  A  documented  compendium  of  parameter-accountable  factor  cause-and-effect 
relationships  for  each  defined  system  level 

Operational  Requirements  Analysis 

Consistent  with  the  extension  of  the  performance  requirements  profile  to  lower 
system  levels,  a  corresponding  expansion  of  the  operational  requirements  profile 
is  to  be  accomplished.  System  and  subsystem  parameters  and  concepts  associated 
with  manning,  operating,  maintaining,  and  logistieally  supporting  the  system,  which 
comprise  the  effectiveness  parameter  of  availability,  are  to  be  defined  in  detail  and 
quantitative  values  established.  These  include  individual  parameters  which  measure 
the  performance  characteristics  of  the  following  operational  elements: 

•  Maintenance 

•  Employment 

•  Deployment 

•  Transportation 

•  Personnel 

•  Base  and  depot,  support 

•  Training 

•  Test  and  activation 

Examples  of  operational  availability  measures,  concepts,  and  parameters  to  be  refined 
were  presented  previously  in  Table  3-3  of  paragraph  3-5. 

The  basic  inputs  required  to  define  and  establish  the  system  operational  parameters 
are  the  revised  and  expanded  (1)  time-lines  depicting  ground  operations,  (2)  RASs 
which  identify  personnel,  training,  training  equipment,  and  procedural  data  require¬ 
ments  imposed  by  the  equipment  and  facilities  defined  in  the  Inventory  Equipment 
Requirements  Specifications,  (3)  functional  analyses  of  end-item  maintenance  functions 
for  AGE  and  OGE,  (4)  maintenance  design  requirements,  including  maintenance  person¬ 
ae!  and  training,  from  the  maintenance  RASs,  (5)  end-item  maintenance  sheets,  (6)  mis¬ 
sion  analysis  and  FOM  descriptions,  and  (7)  RAD  and  CFP/TDP  baseline  documents. 
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The  updated  analysis  results  on  operational  requirements  are  directly  usable  to 
provide  the  following: 

•  The  basic  technical  traceability  of  the  FOMs  to  system  and  subsystem  design 
requirements  for  manning,  operating,  maintaining,  and  logistics  support 
parameters  influencing  total  availability,  such  as  turn-around  time,  reaction 
time,  or  in-commission  rate 

•  The  principal  benchmarks  and  reference  frame  for  the  updating  of  the 

vail  ability  effectiveness  parameter,  models,  and  analyses 

•  A  documented  compendium  of  operational  parameter  -  accountable  factor 
cause-and-effect  relationships  for  each  defined  system  level 

Effectiveness  Parameter  Selection 

The  performance  and  operational  requirements  analysis  updating  activities  were 
directed  at  defining  the  total  set  of  principal  subsystem  and  system  performance 
parameters.  These  parameters  represent  the  measurable,  or  otherwise  determinable, 
required  outputs  of  system  functions  to  be  achieved  as  evidence  that  specific  demands 
of  the  mission  can  be  met.  An  initial,  gross  reduction  of  this  total  set  of  principal 
parameters  to  a  restrictive  subset  of  critical  system  parameters  influencing  effective¬ 
ness  is  made  during  Concept  Formulation. 

The  criticality  matrices  and  tables  previously  prepared  are  to  be  updated  to  include 
the  top-level  functional,  specialty,  and  operational  system  parameters  contributing 
significantly  to  the  availability,  dependability,  and  capability  parameter  sets  of 
system  effectiveness.  The  critical  accountable  factors,  '“cting  as  input  variables 
to  the  system  parameters,  also  will  require  expansion  and  re-examination.  These 
accountable  factors  normally  will  be  the  important  output  parameters  of  major  sub¬ 
system  functions  contributing  to  principal  system  functions,  and  will  define  the  de¬ 
sign  and  performance  requirements  to  be  placed  on  the  subsystems.  It  is  expected 
that  the  criticality  matrices  will  not  require  extension  to  the  subsystem  parameter 
level.  Such  an  extension  for  all  first-level  functions  wouid  be  extremely  detailed. 

Also,  the  multiple  interactions  of  accountable  factors  normally  present  at  lower 
design  levels  would  cbscure  the  visibility  provided  by  the  criticality  matrices  and 
tables  on  the  relative  importance  of  critical  system  parameters  and  accountable 
factors  to  the  FOMs. 
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For  the  purposes  of  trade-off  optimization  and  apportionment  analysis,  a  refinement 
and  extension  of  the  transfer  functions  to  more  accurately  describe  the  functional 
cause-and-effect  relationships  of  the  critical  accountable  factors  to  their  system 
and  subsystem  parameters  will  be  required.  For  simplicity,  however,  transfer 
functions  are  to  be  established  and  documented  only  for  top-level  system  and  first- 
level  subsystem  functions,  with  all  input  accountable  factors  below  the  first  level 
considered  as  a  total  ensemble,  independent  of  the  design  levels  with  which  they 
are  associated.  The  synthesis  method  and  analysis  methods  I  and  II  ai*e  usable  to 
determine  the  required  combinations  of  inputs,  transfers,  and  outputs.  The  synthesis 
method  can  be  used  to  determine  the  transfer  functions  connecting  inputs  with  outputs 
if  the  inputs  and  outputs  requirements  are  known  or  can  be  reasonably  postulated. 

This  method  was  previously  described  in  Chapter  3  and  summarized  in  Table  3-4. 
Analysis  Method  I  can  be  used  to  determine  the  performance  outputs  if  the  charac¬ 
teristics  for  the  inputs  and  how  they  are  operated  upon  (transfer  functions)  are 
known.  Analysis  Method  II  addresses  the  reverse  problem  of  determining  account¬ 
able  factor  inputs  for  known  performance  outputs  and  transfer  functions.  The 
general  characteristics  of  the  three  methods  are  outlined  and  compared  in  Table  4-1. 
Further  details  on  these  methods  are  described  in  Appendix  A. 

Each  transfer  function  relating  a  system  performance  parameter  to  its  accountable 
factors  can  be  represented  by  an  analog  diagram  with  transformed  mathematical 
functions.  Additionally,  for  time-varying  systems  which  are  linear  (or  suitably 
linearized  with  a  method  such  as  perturbation),  each  transfer  function  can  be 
represented  by  an  adjoint  analog.  Examples  of  such  systems  are  closed  loop  systems, 
feedback  systems,  and  similar  null-seeking  systems.  The  adjoint  analog  is  obtained 
by  reversing  all  inputs  and  outputs  and  generating  all  time-functions  backwards. 

For  example,  if  a  system  analog  has  3  inputs  and  1  output,  then  the  system  adjoint 
must  have  1  input  and  3  outputs. 

Adjoint  analysis  is  a  special  case  oi  Analysis  Methods  I  and  II  and  is  usable  as  u 
preliminary  design  technique  to  statistically  analyze  and  optimize  linear,  time- 
varying  systems.  The  method  employs  parameter  variation  analysis  commonly  used 
bv  system  developers. 


TABLE  4-1  COMPARISON  OF  SYNTHESIS  AND  ANALYSIS  METHODS 


Characteristic 

Synthesis  Method 

Analysis  Method  I 

Analysis  Method  11 

• 

Phase  normally 
applicable 

Concept  Formulation 
and  Contract 
Definition 

Contract  Definition 
and  Acquisition 

Contract  Definition 
and  Acquisition 

t 

Relative  ease  of 
application 

Difficult 

Simple 

Difficult 

• 

Relationship  of 
variables* 

Transfer  functions 
are  implicit  func¬ 
tions  of  inputs  and 
outputs 

Outputs  are  explicit 
functions  of  inputs 
and  transfer  functions 

Inputs  are  implicit 
functions  of  outputs 
and  transfer  functions 

• 

Information 
needed  to  start 
preliminary 
design 

Minimum  amount. 
Requires  knowledge 
of  inputs  and  outputs. 
Then  find  transfer 
functions 

More  than  synthesis 
method.  Requires 
knowledge  of  inputs , 
system  functions, 
transfer  functions, 
and  configuration 
details  on  subsystems 
and  equipment.  Then 
find  outputs 

More  than  synthesis 
method.  Requires 
knowledge  of  outputs, 
system  functions, 
transfer  functions , 
and  configuration 
details  on  subsystems 
and  equipment. 

Then  find  inputs 

G 

Input -output 
expression  for 
linear,  time- 
varying  systems 

Provided  by  a 
superposition 
integral 

Provided  by  same 

superposition 

integral 

Provided  by  same 
superposition  integral 

• 

Procedure 

Find  transfer  func¬ 
tions  to  satisfy 
superposition 
integrals.  Then 
find  physical 
characteristics  of 
system  which 
satisfy  transfer 
functions 

iterative  application 
of  superposition 
integrals  by  changing 
inputs  repeatedly, 
which  alters  form  of 
transfer  functions 
until  outputs  are 
obtained 

Iterative  application 
of  superposition 
integrals  by  changing 
outputs  repeatedly, 
which  alters  form  of 
transfer  functions 
until  inputs  are 
obtained 

*  Inputs  and  outputs  normally  are  in  the  form  of  time-functions. 
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TABLE  4-1  COMPARISON  OF  SYNTHESIS  AND  ANALYSIS  METHODS  (Continued) 


Characteristic  Synthesis  Method  Analysis  Method  I  Analysis  Method  II 


Optimizing 

procedure 

(example) 


Find  transfer  trac¬ 
tion  such  that  the 
difference  (error) 
between  each  output 
and  the  true  output 
is  as  small  as  pos- 


Find  outputs  such  that 
the  difference  (error) 
between  each  output 
and  the  true  output  is 
as  small  as  possible, 
using  the  known  trans- 


Find  inputs  such  that 
the  difference  (error) 
between  each  output 
and  the  true  output  is 
as  small  as  possible, 
using  the  known  trans- 


sible,  using  this 
transfer  function 

fer  function 

fer  function 

•  Error  criterion 
(example) 

(1)  minimum  time  - 
averaged  squared 
difference  or  abso¬ 
lute  difference ,  or 

(2)  minimum  ex¬ 
pected  value  ef 
squared  difference 

Same  as  (I)  and  (2)  of 
Synthesis  method 

Same  as  (1)  and  (2)  of 
Synthesis  method 

•  Solution  method 
for  simple, 
linear  time- 
varying  systems 

Determine  transfer 
functions  using 
vector  analysis, 
matrix  theory,  and 
Laplace  transforms, 
for  example 

Determine  outputs  by 
solving  differential 
equations  or  evaluat¬ 
ing  integrals  connect¬ 
ing  outputs  to  inputs 

Determine  inputs  by 
solving  differential 
and  matrix  equations 
connecting  inputs  to 
outputs 

•  Solution  method 
for  complex, 
linear  and  non 
linear  time- 
varying  systems 

Combination  of 
numerical  and 
analytical  proce¬ 
dures  using  digital 
computations 

Same  as  for  Synthesis 
method 

Same  as  for  Synthesis 
method 

*  Special  tech-  No  simple  method  Adjoint  method  Adjoint  method 

nique  to  facili¬ 
tate  solution 
for  linear, 
time-varying 
system 
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With  the  expansion  and  detail  definition  of  the  principal  transfer  functions,  the 
sensitivity  functions  previously  developed  on  a  gross  basis  can  be  updated  at  the 
system  level  and  expanded  to  the  first-level.  This  will  provide  the  insight  into  the  lower- 
level  trade-offs  required  for  an  optimum  balance  of  cost  and  performance  and  the  detail 
design  requirements  for  major  CEIs.  The  results  of  the  sensitivity  analyses  for  the  sys¬ 
tem  parameters  are  used  to  revise  the  normalized  sensitivity  coefficients  and  accountable 
factors  to  be  included  in  the  criticality  matrices. 

The  basic  data  required  to  revise  and  further  define  the  system  and  subsystem  param¬ 
eters  and  accountable  factors  critical  to  system  performance  and  operations  are  (1)  the 
functional  diagrams  and  related  RASs  and  time-line  sheets,  (2)  the  performance  and 
operational  requirements  profile,  (3)  end-item  maintenance  sheets  and  related  mainte¬ 
nance  RASs,  (4)  the  initial  system  specification,  and  (5)  the  RAD  and  CFP/TDP  baseline 
documents.  The  results  of  the  updated  selection  of  effectiveness  parameters  are 
directly  usable  to  refine  the  effectiveness  models  to  be  applied  for  evaluation,  optimi¬ 
zation,  trade-off,  and  apportionment  of  the  FOMs,  effectiveness  parameters,  and  sys¬ 
tem  performance  parameters  composited  by  the  effectiveness  parameters  and  FOMs. 

Model  Sti  ucturing 

System  models  developed  and  employed  during  Concept  Formulation  for  the  evaluation 
of  the  preliminary  FOMs  will  require  updating  for  use  in  the  evaluation  of  the  defined 
principal  FOMs.  The  principal  FOMs  may  not  correspond  necessarily  to  the  pre¬ 
liminary  FOMs.  Additionally,  the  need  for  the  system  FOM  and  cost  effectiveness 
models  for  Contract  Definition  to  provide  an  accurate  and  realistic  analog  of  the  system's 
cost  and  performance  behavioral  characteristics  will  precipitate  a  necessary  revision 
and  expansion  of  the  previously  established  system  models.  The  mi  del  structuring  up¬ 
dating  activity  normally  will  includa  the  following: 

•  Review  and  reassessment  of  previous  assumptions  used,  including  the  explicit 
rationale  and  justifications  for  the  assumptions.  Refine  and  modify  assumptions 
based  upon  the  current,  knowledge  of  design  and  performance  details.  Fist  all 
such  assumptions,  rationale  ,  and  justifications. 
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•  Expansion  of  the  limited  system  state  model,  normally  a  two-state  analysis 
model  formulated  during  Concept  Formulation  to  a  larger,  but  manageable 
number  of  state  groups  that  will  realistically  represent  the  significantly  dif¬ 
ferent  operating  conditions  that  the  system  may  be  in  during  its  mission  assign¬ 
ment.  State  groups  are  to  be  defined  and  established  where  measurably  dif¬ 
ferent  mission  outcomes  are  present,  and  the  associated  probabilities  can  be 
realistically  and  validly  estimated.  On  this  basis,  and  consistent  with  the 
design  details  being  evolved,  the  states  to  be  defined  for  an  effectiveness 
analysis  are  to  be  responsive  to  the  system  operating  conditions  of  (1)  fully 
operable  (mission  not  aborted),  (2)  fail-operable  (system  failures,  but  mis¬ 
sion  not  aborted),  and  (3)  inoperable  (abort).  For  the  fail-operable  system 
condition,  a  mosaic  of  mission  outcomes  is  possible.  However,  this  spectrum 
normally  is  analytically  manageable.  The  fail-operable  system  condition  in¬ 
cludes  the  different  outcomes  for  definable  combinations  of  failed  major  equip¬ 
ment  and  their  associated  functions  that  (1)  are  redundantly  present,  (2)  represent 
extra  performance  margins,  (3)  possess  over-ride  alternatives,  or  (4)  will  not 
materially  reduce  capability.  The  fail-operable  system  operating  condition  can 
be  partitioned  into  a  discrete,  limited  number  of  states  corresponding  to  equip¬ 
ment  failure  combinations  with  similar  magnitude  of  effectiveness  influence. 

A  partially  failed  system  operating  condition  is  synonymous  with  the  condition 
of  fail-operable.  Any  condition  less  than  this  is  considered  inoperable,  and 
hence  of  zero  capability. 

•  Development  of  a  state  flow  diagram  to  represent  the  progression  of  the  multiple 
system  states  during  the  mission.  This  diagram  is  to  be  time-based  and  re¬ 
sponsive  to  any  partitioning  of  the  mission  into  discrete  time  intervals  for 
separately,  definable  mission  tasks  or  events.  An  example  of  a  three-state 
flow  graph  is  shown  in  Figure  4-1. 

•  Validation,  revision,  and  expansion  of  the  probability  estimates  for  each  of  the 
defined  system  states  appropriate  at  the  begining,  and  at  the  end  of  the  mission. 
These  estimates  can  be  extrapolated  from  sources  such  as  historical  data  from 
similar  or  related  systems,  data  in  MIL-HDBK-217  and  RADC  Reliability 
Notebook,  random  sampling  simulations,  and  theoretical  analyses. 
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System  Effectiveness 
Three-State  Flow  Graph 


•  Re-examination  and  definition  in  detail  of  the  technical  scenario  for  the 
evaluation,  including  the  distinct  le  vels  of  threat  groupings  expected  to  be 
present  for  each  mission.  The  threat  groups  are  to  be  composited  so  as 
to  represent  significantly  different  effects  that  are  expected  on  the  magni¬ 
tude  of  capability  achievable  by  the  system. 

•  Formulation,  refinement,  and  expansion  of  the  system  effectiveness  models 
to  be  used  for  the  evaluation  of  the  principal  FOMs  defined  for  the  system, 
and  the  translated  FOMs  defined  for  major  subsystems.  The  models  are  to 
take  into  account  the  effectiveness  parameters  of  availability,  dependability, 
and  capability.  These  parameters  typically  will  represent  a  technical  in¬ 
tegration  of  all  the  principal  system  performance,  technical  specialty, 

and  operational  parameters  of  the  system  that  will  critically  contribute  to 
the  magnitude  of  an  FOM  achievable.  Submodels  will  be  required  for  each 
of  the  three  effectiveness  parameters  to  provide  the  technical  logic  of  how 
the  included  assemblage  of  critical  parameters  are  related.  Additionally, 
for  each  critical  system  parameter  composited  by  the  effectiveness  param¬ 
eters,  a  separate  model  is  to  be  formulated  for  use  In  its  evaluation.  These 
system  parameter  models  normally  will  be  coincident  with  the  transfer 
functions  that  mathematically  relate  an  output  system  parameter  to  its  en¬ 
semble  of  critically  dependent  first -level  accountable  factors.  The  trans¬ 
fer  functions  typically  can  be  applied  in  analytical,  statistical,  or  simula¬ 
tion  analyses. 

Refinement  and  updating  of  the  system  cost  model.  The  cost  models  are  to 
take  into  account  the  phase-related  categories  of  development,  acquisition, 
and  operational  and  maintenance  resource  costs  (commodity  size,  tech¬ 
nology,  and  dollars)  on  a  total  program  basis  spanning  the  useful  life  of  the 
system  complement.  Submodels  also  are  required  to  provide  the  cost  re¬ 
lationships  of  these  broad  aggregations  of  cost  to  their  major  categories, 
such  as  those  previously  listed  in  Table  3-9  of  paragraph  3-7,  Chapter  3, 
for  the  Concept  Formulation  Phase.  The  submodels  are  to  be  suitable  for 
integration  into  the  total  system  cost  model.  An  alternate  to  the  develop¬ 
mental,  acquisition,  and  operational  and  maintenance  categories  of  cost 
could  be  the  Level  1  breakout  of  cost  elements  from  the  Program  Work 
Breakdown  Structure  (PBS).  Examples  of  such  cost  categories  are  RDT&E, 
system  procurement,  military  construction,  operations  and  maintenance, 
military  personnel,  other  procurement,  etc.  These  categories  can  be 
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directly  correlated  with  the  broad  phase-related  categories,  if  such  a 
correspondence  is  desired  for  cost  estimating  purposes.  Where  the  PBS 
is  used  as  a  basis  for  categorizing  costs  to  be  integrated  by  the  system 
cost  model ,  the  cost  relationships  are  tc  be  defined  to  Level  in  of  the  PBS 
as  a  minimum.  This  level  normally  will  include  the  detail  work  effort  and 
contractor  effort.  Additionally,  contractor  cost  relationships  associated 
with  his  Work  Breakdown  Structure  (WBS)  are  to  be  defined  for  at  least  the 
next  lower  summary  level  of  cost  categories.  System  cost  estimates  nor¬ 
mally  will  represent  a  composite  of  inputs  from  participating  commands, 
such  as  the  using  command,  ATC,  AFLC,  and  AFSC.  These  inputs  in  part 
are  based  on  data  provided  by  the  involved  contractors,  with  contractor 
estimates  obtained  through  responses  to  the  RFP  ami  the  studies  contracted 
for  during  this  phase.  Methods  to  be  used  for  cost  sensitivity  and  variance 
analysis  to  provide  a  measure  of  the  precision  of  the  cost  data  are  to  be 
defined  in  detail  as  a  part  of  the  model  structuring  refinement  activity. 
Examples  of  techniques  useful  for  cost  precision  analysis  are  the  cost  vari¬ 
ance  and  PERT-Cost  procedures. 

•  Reformulation  of  the  cost  effectiveness  models  as  necessary  and  refinement 
of  the  cost  tffectiveness  criterion  for  each  mission.  Identification  from  the 
design  details  being  expanded  concurrently  of  the  significant  trade-off  alter¬ 
natives  for  the  accountable  factors,  system  parameters,  and  system  func¬ 
tions.  Determination  of  the  technical  constraint  boundaries  and  the  resource 
costs  associated  with  each  alternative,  or  each  set  of  intersecting  alternatives. 

•  Establishment  of  detail  requirements  for  input  data  which  are  fundamental  to 
obtaining  an  analytical  or  simulated  output  for  each  system  and  subsystem 
effectiveness,  cost,  and  cost  effectiveness  model  defined.  Table  4-2  pro¬ 
vides  a  listing  of  the  typical  input  data  requirements  to  be  defined  and  the 
expected  outputs  which  can  be  derived  from  this  data  by  application  of  the 
transfer  functions  incorporated  in  the  models.  Additionally,  a  data  guide 

is  to  be  prepared  to  document  data  sources  which  are  to  be  used  for  effec¬ 
tiveness  analyses,  including  existing  sources  and  those  supplemental  sources 
expected  to  be  available  and  utilized  during  later  acquisition  and  operational 
phases. 


4-19 


-f- 


ii 


i  i 

;  i  ;  ! 

» «  i 

!  i  TABLE  4-2  TYPICAL  INPUT  REQUIREMENTS  AND  MODEL  OUTPUTS 


Input  Data  Requirement 

Output  Estimate 

i  - 
1  1  ■ 
fci 

\  1 

•  Distribution  or  discrete  range  of  values 
for  each  critical  accountable  factor 
(design  variable) 

Distribution  of  values  for  each  system 
performance  parameter  critically  con¬ 
tributing  to  the  capability  effectiveness 
parameter  set. 

i 

i-'i 
>  i 

i  .■ 

f  • 

•  Failure  rates,  failure  modes,  redun¬ 
dancies,  alternate  modes  of  operations, 
and  in-operation  maintenance,  repair, 
and  adjustment  rates. 

Distribution  of  values  for  system  re¬ 
liability  parameter  of  tne  dependabil¬ 
ity  effectiveness  parameter  set. 

?  •’ 
i 

[ ' 

V 

[I 

•  Exposure  time  and  reaction  time  dis¬ 
tributions,  dispersal  radius,  hardening 
level,  alternate  modes  of  initiation, 
threat  levels  and  patterns  expected, 
and  mobility. 

Distribution  of  values  for  system 
survivability  parameter  of  the  depend¬ 
ability  effectiveness  parameter  set. 

1 

•  Operational  schedules,  number  of 
available  systems,  assets  available, 
time  between  inspection,  checkout  time, 
checkout  failure  rates,  inventory  fill 
rates,  removal  rates,  time  required 
for  maintenance,  transportation  time, 
deployment  mode,  and  characteristics 
of  complementing  systems. 

Distribution  of  values  for  system 
availability  effectiveness  parameter. 

Also  suitability  of  equipment  spares, 
maintenance  and  handling  facilities, 
and  manpower  allocations. 

1 

■i 

? 

i 

■  t 

■  f 

•  Probability  of  occurrence  and  time 
distributions  for  critical  maintenance 
items,  maintenance  frequency  and  time 
duration  by  type  of  items,  maintenance 
assets  of  personnel,  skills,  equipment, 
and  types  of  facilities,  maintenance 
activity  sequencing  for  minimum  down¬ 
time,  mean  turnaround  span  for  each 
item,  and  delays. 

Distribution  of  values  for  maintenance, 
deployment,  transportation,  personnel, 
base  and  depot  support,  training,  and 
test  and  activation  system  parameters 
of  the  availability  effectiveness  param¬ 
eter  set.  Also  optimum  maintainability 
policy  (e.g. ,  level  of  maintenance 
which  maximizes  reliability  gain  per 
unit  cost). 

e  Resource  cost  of  commodity  size 
(skills,  material,  facilities,  etc.), 
technology,  and  dollars  per  mission. 

Expected  total  and  per  year  system 
life  cycle  cost  per  mission. 

j 

•  Output  estimates  for  system  avail¬ 
ability,  dependability,  capability, 
and  cost  parameters. 

Distribution  of  values  for  system  and 
cost  effectiveness  measures. 

4-20 


L. 


System  and  Cost  Effectiveness  Analysis 

System  and  cost  effectiveness  analyses  are  to  be  updated  and  to  be  conducted  on  a  more 
refined  basis  consistent  with  the  amount  of  design  details  being  defined  for  the  system. 
Each  effectiveness  parameter  included  in  the  established  models  is  to  be  analyzed  with 
respect  to  the  specific  influences  and  trade-off  potentials  of  critical  accountable  factors 
and  effects  of  threats  on  the  composited  system  parameters.  The  ultimate  output  of 
these  analyses  is  to  technically  establish  and  define  in  detail  a  3ystem  configuration 
with  optimum  performance  and  cost  balance.  Specific  analyses  required  during  this 
phase  include  the  following: 

e  Trade-off  analyses  of  vital  design  alternatives  to  provide  design  visibility  and 
authoritative  knowledge  of  (1)  the  high  technical  and  cost  risk  areas  requiring 
configuration  decisions  to  reduce  such  risks  to  sensible  ones,  (2)  the  inter¬ 
active  influence  of  alternate  design  details  and  functions  or.  each  FOM  and  its 
eflectiveness  parameters,  and  (3)  the  gross  magnitude  of  effectiveness  im¬ 
provement  achievable  in  each  configuration  analyzed. 

•  Analyses  of  critical  accountable  factors  to  analytically  determine  their  specific 
range  of  required  values  for  maximum  effectiveness.  These  analyses  are  to 
include  a  refinement  and  more  accurate  determination  of  the  sensitivity  func¬ 
tions  relating  incremental  changes  in  values  of  these  accountable  factors  to 
changes  in  effectiveness  parameters  and  FOMs.  The  criticality  matrix  is  to 
be  updated  as  a  result  of  this  analysis. 

•  Analyses  of  the  defined  system  states  to  exclude  those  states  and  considerations 
which  are  least  critical  to  the  mission  for  model  simplification.  Analytical, 
statistical,  and  mathematical  simulation  techniques  can  be  used  to  derive  the 
reduced  critical  state  set. 

•  System  effectiveness  analyses  to  provide  an  estimate  for  each  defined  FOM 
measure.  These  estimates  are  usually  derived  from  a  sequence  of  optimiza¬ 
tion  iterations.  (A  typical  optimization  technique  to  employ  is  the  Analysis  1 
method,  previously  described  in  this  paragraph,  with  a  forward  and  backward 
optimization  procedure  after  terminal  design  constraints  have  been  met  from 
previous  iterations.  On  a  forward  pass,  which  is  the  improvement  pass,  the 
output  is  determined.  The  adjoint  equations  then  are  solved  on  the  backward 
pass  using  the  improved  output  values, )  Analyses  of  system  effectiveness  are 
to  be  performed  separately  for  the  availability,  dependability,  and  capability 
parameters.  Availability  analyses  are  directed  at  defining  and  evaluating  the 
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condition  or  readiness  of  the  candidate  system  configuration  at  the  beginning 
of  an  assigned  mission.  Updated  probability  estimates  for  each  state  which  is 
defined  as  critical  are  to  be  established  and  used  for  this  analysis.  Depend¬ 
ability  analyses  are  aadressed  to  an  evaluation  of  the  operating  conditions  of 
the  system  during  and  at  the  end  of  the  mission  for  each  defined  availability  state. 
Transition  and  outcome  probability  estimates  will  be  needed  to  assess  this 
parameter.  Capability  analyses,  which  are  performed  to  evaluate  the  output  of 
the  critical  system  performance  parameters,  also  will  be  required.  For  each 
system  parameter,  the  output  value  corresponding  to  each  of  the  different  de¬ 
pendability  states  is  to  be  estimated. 

•  Cost  analyses  to  determine  the  cost  cf  each  major  performance  or  operational 
alternative  to  be  analyzed. 

e  Cost  effectiveness  analyses  to  establish  the  optimum  performance,  time,  and 
cost  balance. 

•  Statistical  analyses  to  establish  or  refine  the  lower  confidence  estimate  for  each 
FOM  and  cost  effectiveness  measure,  taking  into  account,  as  a  minimum,  sta¬ 
tistical  errors,  assumption  errors,  and  cost  variances. 

Analyses  are  to  be  performed  and  estimates  tabulated  for  each  mission  and  for  the  most 
probable  and  worst  level  of  threats.  Estimates  are  to  be  provided  on  a  current  and 
5-year  projected  basis  for  the  measures  of  cost  effectiveness,  FOMs,  effectiveness 
parameters,  and  critical  system  parameters. 

Information  Flow 

The  basic  data  required  for  the  effectiveness  analysis  refinement  activity  are  princi¬ 
pally  available  from  the  following  activities,  most  of  which  are  progressively  updated 
throughout  the  Definition  Phase: 

o  Baseline  requirement  documents  defining  system  concepts 

•  CFP/TDP  and  RAD 

•  Effectiveness  report  of  Concept  Formulation  Phase 

•  Program  work  breakdown  structure 
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•  Detail  performance  and  design  definition  studies 

»  Functional  analyses,  RASs,  tradeoff  studies,  schematic  diagrams,  and 
time-lines. 

The  outputs  of  this  activity  will  contribute  to  the  following; 

•  Establishment  and  validation  of  firm  and  achievable  system  specification,  CEI 
detail  specifications,  and  Inventory  Equipment  Requirement  Specifications 

•  Definition  of  intersystem  and  intrasystem  inteifaces 

•  Identification  of  high  performance  and  cost  risk  areas 

•  A  basis  for  the  preparation  of  augmenting  and  compatible  program  plans  for  the 
specialty  technical  disciplines 

•  Validation  of  the  technical  approach  and  creation  of  the  best  cost -effective 

system 

•  Identification  of  personnel  and  training,  logistics  support,  and  other  operational 
requirements 

•  Identification  of  data  requirements. 

A  summary  of  the  basic  information  network  for  the  effectiveness  analysis  refinement 
activity  is  shown  in  Figure  4-2. 

4-3  APPORTIONMENT  ANALYSIS  [step  E10 
General 

The  apportionment  of  system  effectiveness  measures  and  their  influential  parameters 
is  a  technical  process  which  must  be  implemented  if  the  system  design  criteria  to  be 
established  are  to  be  consistent  with  Lie  inquired  system  performance  to  meet 
mission  objectives.  System  effectiveness  measures  normally  to  be  apportioned  during 
the  Definition  Phase  include  FOMs,  their  constituent  parameters  of  availability,  de¬ 
pendability,  and  capability,  and  critical  system  parameters  (whose  apportioned  first- 
level  accountable  factors  become  the  top  design  parameters  of  major  CEIs).  Appor¬ 
tionment  can  be  technically  considered  as  being  a  direct  result  of  an  optimization 
procedure.  Generally,  apportionment  is  aceomphshed  by  establishing  with  an  iter¬ 
ative  procedure  the  ensemble  of  input  values  which  will  provide  the  required  balance 
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of  optimum  output  values  tor  the  FOM  and  cost  measuies.  Traditionally,  apportion¬ 
ment  implies  a  rational  allocation  of  ai\  output  to  its  ensemble  of  inputs.  In  practice, 
the  rational  basis  for  such  a  top-level  tc  lower-level  allocation  is  to  build  from  the 
lower-level  design  details  up  through  transfer  functions  to  the  top-level.  This  building 
prcees.?  involves  an  oscillating  series  of  allocations  and  adjustments  of  allocations  until 
achievable,  optimum  values  for  the  accountable  factors  are  determined  which  will  op¬ 
timize  the  output  terminal  parameters^-  Having  thus  optimized  the  input  design  variables 
with  respect  to  the  FOMs,  the  technical  connections  between  these  variables  and  the 
FOMs,  such  as  system  and  effectiveness  parameters,  will  in  turn  be  compositely 
optimized. 

Apportionment  of  FOMs 

The  apportionment  of  each  principal  FOM  defined  for  an  overall  weapon,  support,  or 
electronic  system  configuration  is  a  two-step  process  that  can  be  accomplished 
typically  as  follows: 

e  Translate  each  top-level  system  FOM  into  a  set  of  lower,  first-level  sub-FOM 
measures.  As  a  minimum,  this  is  to  be  accomplished  for  each  major  subsys¬ 
tem.  The  sub-FOMs  must  be  capable  of  being  technically  described  in  t;rms 
of  specific  subsystem  performance  parameters  that  are  observable  and  meas¬ 
urable.  A  sub-FOM,  therefore,  represents  an  integration  of  a  restrictive  set 
of  terminal  performance  characteristics  associated  solely  with  a  first-level 
subsystem  (or  a  major  CEI  depending  on  the  point  of  reference).  It  is  a  meas¬ 
ure  of  the  performance  value  or  merit  of  the  subsystem  with  respect  to  its 
contribution  to  the  performance  value  or  merit  of  the  overall  system.  Each 
sub-FOM  also  must  possess  a  technical  link-up  with  the  system  FOMs,  such 
as  by  contributing  or  being  identical  v.’ith  a  dsfi'.  ed  system  parameter,  or  by 
contributing  to  a  set  of  system  parameters.  One  of  these  two  technical  connec¬ 
tions  usually  is  present,  and  can  be  represented  by  a  performance-oriented 
logic  diagram.  In  a  similar  manner,  a  companion  connection  exists  between  the 
availability,  dependability,  and  capability  effectiveness  parameters  of  a  sub¬ 
system  (integrated  by  a  sub-FOM)  and  the  effectiveness  parameters  of  a  system 
composited  by  a  system  FOM.  An  overview  of  tne  technical  relationship  of  a 
subsystem  FGM  to  its  system  FOM  is  shown  in  Figure  4-3.  Additionally  shown 
is  a  perspective  of  how  their  associated  performance  parameters  are  integrated  h 
these  FOMs. 
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•  Numerically  allocate  an  overall  system  FOM  to  its  defined  sub-FOMs.  The 
technical  analog  of  the  connection  between  the  sub-FOMs  the  system  FOM, 
just  described,  will  indicate  the  syslem  and  subsystem  parameters  to  be 
included  in  the  apportionment  analysis.  Techniques  for  the  numerical  apportion¬ 
ment  of  system  FOMs  include  (1)  Lagrangian  method,  (2)  Lagrangian  method 
with  priority  lists,  (3)  dynamic  programming,  (4)  direct  comparison  (direct 
search),  (5)  linear  programming,  (6)  gradient  projection,  and  (7)  calculus  of 
'variations.  These  techniques  are  equally  applicable  for  the  apportionment  of 
system  effectiveness  related  measures  of  availability,  dependability,  capability, 
and  system  parameters.  A  guideline  for  selecting  the  technique  to  use  for  a 
particular  application  is  provided  in  Table  4-3.  Appendix  D  summarizes  the 
detail  procedure  for  each  of  these  techniques. 

Apportionment  of  System  Parameters 

The  terminal  performance  and  operational  behavior  of  a  system  are  observable  and 
measurable  by  its  top-level  system  parameters.  Along  with  the  system  FOMs,  these 
output  parameters  represent  the  focal  point  of  most  optimization  processes.  The  best 
combination  of  input  values  for  critical  accountable  factors  within  resource  or  require¬ 
ment  constraints  which  will  optimize  these  parameters  is  to  become  a  part  of  the  top 
design  criteria  for  major  CEIs.  A  branching  of  the  apportionment  process  to  lower- 
level  accountable  factors  normally  will  not  be  required  during  the  Definition  Phase. 

An  input  accountable  factor  may  not  be  in  the  same  measurement  unit  as  the  system 
.  utput  parameter(s)  it  influences.  This  is  typical  of  many  functional  parameters  com¬ 
posited  by  the  capability  parameter.  In  most  cases  where  this  situation  i3  present, 
there  is  an  analytical  connection  of  the  different  measurement  units  through  transfer 
functions.  On  the  other  hand,  accountable  iactovs  may  have  the  same  measurement 
unit  as  their  output  parameters  such  as  those  which  normally  are  summed  or  multiplied 
(e.g,,  error,  weight,  lift,  drag,  probabilities,  and  turnaround  time).  Examples  of 
both  accountable  factors  with  different  measurement  units  than  the  system  outputs  they 
influence,  and  those  with  the  same  input -output  m<  isxrement  units  are  listed  in 
Table  4-4.' 
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TABLE  4-3  APPLICATION  GUIDELINES  FOR  SELECTED 
APPORTIONMENT  TECHNIQUES 


APPORTIONMENT  TECHNIQUE  PROCEDURE 

Lagrangian  Method  -  Maximize  difference  between  output*  and  sum  of 
constraint  variables. 

anglan  Method  With  Priority  Lists  —  Add  priority  numbers  to  determine 


optimization  path. 

Dynamic  Programming  -  Optimize  one  stage  of  problem  at  a  time. 

0  Direct  Comparison  (Direct  Search)  —  Compare  output*  for  each  alternative. 
©  linear  Programming  -  Optimize  output*  based  on  a  system  of  linear 


constraint  functions. 

0  Gradient  Projection  —  Modify  optimization  vector  with  constraint  components. 
0  Calculus  of  Variations  —  Formulate  optimizing  criterion  as  an  integral. 


Apportionment  Technique  AppliCc  le** 


®  ®  ®  ®  ®  ®  ® 


Characteristic 


•  Simple  to  understand 

•  Fast  to  accomplish 

•  Provides  perspective  of  optimization 

•  May  require  computer 

•  Concept  Formulation 

•  Definition 

•  Acquisition 

•  Many  system  inputs 

•  Few  system  inputs 

•  Few  values  for  each  system  input 

•  Continuous  system  inputs 

•  System  inputs  do  not  interact 

•  Linear  transfer  functions 

•  Nonlinear  transfer  functions 


*If  output  is  Figure  of  Merit,  inputs  may  be  system  parameters  or  accountable 
factors 


**X  denotes  applicable; 


denotes  applicable  and  preferred 
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TABLE  4-4  EXAMPLES  OF  ACCOUNTABLE  FACTORS  AND 
PARAMETERS  WITH  DIFFERENT  AND  SAME  MEASUREMENT  UNITS 


Parameter  (Unit) 

Accountable  Factor  (Unit)* 

|DifferentJ[JnitsJ 

• 

System  time  of  flight  (minute) 

Pitch  command  (degree) 

Cutoff  velocity  (f.p.  s. ) 

Aerodynamic  coefficients  ( — ) 

Re-entry  ballistic  coefficients  (-  — } 

• 

System  range  (mile) 

Payload  (pound) 

Total  impulse  (pound-second) 

Pitch  program  (degree) 

• 

System  accuracy  (yard) 

Thrust  offsets  (inch) 

Time  to  cut-off  (microsecond) 

Wind  perturbations  (f.p.  s. ) 

Guidance  alignment  (milliradian) 

|  Same  Units  t 

• 

System  weight  (pound) 

Subsystem  weight  (pound) 

• 

System  probability  of  maintenance 
(percent) 

Subsystem  probability  of  maintenance 
(percent) 

• 

System  probability  of  performing 
function  (Reliability)  (percent) 

Subsystem  probability  of  performing 
function  (Reliability)  (percent) 

• 

System  lift  (count) 

Subsystem  lift  (count) 

• 

System  drag  (count) 

Subsystem  diag  (count) 

• 

System  error  (feet) 

Subsystem  error  (feet) 

• 

System  turnaround  time  (hour) 

Subsystem  turnaround  time  (hour) 

• 

System  volume  (inch'') 

3 

Subsystem  volume  (inch  ) 

• 

System  computer  capacity  (bit) 

Subsystem  computer  capacity  (bit) 

• 

System  probability  of  safety 
(percent/ 

Subsystem  probability  of  safety 
(percent) 

• 

System  gain  (volt) 

Subsystem  gain  (volt) 

• 

System  impulse  (pound -second) 

Subsystem  impulse  (each  stage) 

(pound-second) 

*AU  critical  accountable  factors  are  not  exhaustively  listed  for  each  system  parameter. 
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Apportionment  of  Effectiveness  Parameters 


Optimization  of  an  FOM  invariably  can  be  accomplished  through  two  technical  paths. 
These  are: 

•  By  optimizing  the  first-level  critical  accountable  factors  with  respect  to  the 
FOM,  thereby  optimizing  the  top-level  system  parameters  with  respect  to  the 
FOM. 

•  By  optimizing  the  try-level  system  parameters  directly  with  respect  to  the  FOM. 

It  is  also  possible  to  take  a  uirect  path  from  lower-level  factors.  However,  this  path 
is  not  technically  feasible  during  Contract  Definition  because  of  the  potential  absence 
of  design  details  and  definition  at  lower  design  levels  and  the  lack  of  knowledge  of  the 
precise  effectiveness  influences  from  the  numerous  interactions  of  accountable  factors 
present  at  these  design  levels.  Another  possible  but  technically  undesirable  path  is  by 
directly  optimizing  the  effectiveness  parameters  of  availability,  dependability,  and 
capability  with  respect  to  an  FOM.  Since  those  parameters  typically  are  parameter 
sets  which  are  inclusive  of  multiple  system  parameters,  their  direct  optimization  would 
not  provide  any  intelligence  as  to  the  specific  design  requirements  for  the  system  param- 
eti  rs  and  their  accountable  factors  for  optimum  effectiveness. 

The  need  to  separate  out  the  apportioned  values  for  availability,  dependability,  and 
capability,  apart  from  their  utility  in  an  effectiveness  analysis,  normally  will  arise 
only  if  it  is  desired  to  include  these  parameter  sets  into  system  and  subsystem  perform¬ 
ance  specifications.  In  practice,  it  is  not  expected  that  this  will  be  universally  required, 
except  in  special  applications  where  these  parameters  are  of  critical  consequence,  and 
thus  have  been  traditionally  included  in  specifications.  An  example  is  the  specification 
of  system  availability  for  aircraft,  booster,  electronics,  and  missile  systems  and  for 
training  missions.  Another  situation  where  it  may  be  desirable  to  include  the  avail¬ 
ability,  dependability,  and/or  capabnu,  parameters  in  specifications  is  where  a  trade¬ 
off  option  is  available  for  the  system  developer  to  establish  the  best  combination  of 
system  parameter  values  composited  by  each  effectiveness  parameter,  subject  to  a 
required  value  for  the  effectiveness  parameter.  A  variation  of  this  situation  is  where 
it  is  desired  to  control  both  an  effectiveness  parameter  (such  as  the  capability  param¬ 
eter)  and  ?,  restrictive  group  of  critical,  high  risk  parameters  by  specifying  values  only 
for  the  controlled  parameters.  The  open  design  option  would  then  apply  to  the  values 
for  the  balance  of  the  less  critical  parameters  integrated  by  the  effectiveness  parameter. 
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Procedure 


The  procedure  for  the  accompllshruwnt  of  the  apportionment  analysis  activity  can  be 
summarized  by  the  following  general  steps: 

•  Translate  each  top-level  FOM  Into  a  set  of  tiub-FOM  measures  for  each  first- 
level  subsystem. 

e  Establish  the  technical  connection  of  each  sub-FOM  to  the  system  FOM.  Rep- 
rsumt  this  link -up  with  a  performance-oriented  logic  diagram. 

•  Numerically  allocate  an  FOM  to  its  sub-FOMs  through  the  defined  technical 
connection  of  the  sub-FOMs  to  the  system  parameters  which  they  may  influence. 
Also  allocate  (1)  the  sub-FOMs  to  their  subsystem  performance  parameters, 

(2)  the  system  performance  parameters  to  their  critical  first-level  accountable 
factors,  and  (3)  optionally,  the  system  FOMs  to  their  effectiveness  parameters 
of  availability,  dependability,  and  capability.  Accomplish  the  apportionment 
using  techniques  such  as  those  delineated  in  Table  4-3  previously  described. 

Information  Flow 

The  basic  data  required  for  the  apportionment  analysis  activity  include  the  following: 

•  Specific  descriptions  of  principal  FOMs  and  sub-FOMs 

•  Initial  performance  requirements  from  the  system  specification 

•  Mission,  performance,  and  resource  constraints  from  the  system  specification 
and  baseline  documents 

•  Mission  operational  conditions  (enemy  threat  levels,  natural  environments,  etc. ) 
from  baseline  documents  and  the  effectiveness  analysis  refinement  activity 

•  First  and  top-level  transfer  functions  (including  sensitivity  functions)  and 
criticality  matrix  from  die  effectiveness  parameter  selection  activity. 

•  Initial  input -output  nominals  for  design  parameters  selected  from  trade-off 
and  deterministic  optimization  studies  from  the  effectiveness  analysis  refine¬ 
ment  activity. 

The  basic  outputs  of  this  activity  are  used  to  validate  the  technical  approach  and  to 
establish  realistic  and  firm  design  requirements  for  performance  parameters  to  be 
included  in  the  updated  system  performance  specification  and  detail  specifications  for 
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major  CEL.  A  firm  technical  basis  is,  therefore,  provided  on  design  criteria  which 
will  lead  to  the  development  of  an  optimum  performance -and  cost-effective  Bystem. 
Figure  4-4  summarizes  the  information  network  for  the  apportionment  analysis  activity. 


4-4  EFFECTIVENESS  PROGRESS  MONITORING  AND  DEMONSTRATION 

PLANNING  j  Step  Ell  | 

General 

A  program  will  be  required  to  be  defined  during  Contract  Definition  for  the  monitoring 
of  effectiveness  progress,  and  the  approach  and  procedures  to  be  used  for  demonstra¬ 
tion  of  current  effectiveness  achievement  during  later  Acquisition  and  Operational 
phases.  The  early  planning  of  this  program  will  insure  the  availability  throughout 
later  phases  of  the  following: 

•  A  timely,  integrated,  and  continuous  status  of  current,  planned,  and  demon¬ 
strated  system  performance.  This  visibility  will  provide  a  valid  and  rational 
basis  for  SPO  and  contractor  management  decisions  on  critical  or  sensitive 
design  and  program  areas  requiring  correction  of  deficiencies. 

•  Necessary  and  timely  tests,  test  data,  and  analytical  and  simulation  studies 
for  use  in  (1)  assessing  current  effectiveness  status,  (2)  predicting  future 
performance  progress,  (3)  development  of  more  realistic  target  values  for  FOMs 
and  system  performance  parameters,  and  (4)  demonstration  of  effecti  veness. 


The  system’s  current  performance  value  is  the  terminal,  measurable  behavior  that  is 
expected  to  be  observed  if  the  system  is  to  be  operated  on  the  date  of  the  estimate.  The 
planned  performance  value  ie  the  anticipated  value  of  a  parameter  at  a  designated  point 
in  the  development;  cycle  and  will  reflect  predicted  engineering  changes  and  future  ex¬ 
pected  progress.  The  demonstrated  performance  value  is  that  observable  from  actual 
operational  performance  tests  normally  associated  with  Category  III  testing  and  Tech¬ 
nical  Approval  Demonstration  (TAD)  testing  (or  Category  I  and  n  system  testing  if  the 
TAD  equivalent  is  performed  during  such  tests).  A  planned  performance  value  if  accu¬ 
rately  estimated  will  converge  to  the  demonstrated  performance  value. 


4-32 


SYSTEM  fc  COST 
EFFECTIVENESS 
MANUAL 


EFFECTIVENESS 

PROCESS 


COMPOS » i 
ACTIVITIES 
FROM  FIGURE  t, 
DEFINITION 
PROCESS, 
AFSCM  375-4 


DEFINITION  PHASE 


Apportionment  Analysis 

Page 

B 

Information  Network 

4-33 

Effectiveness  Progress  Monitoring 

A  defined  plan  for  monitoring  effectiveness  progress  during  Acquisition  and  Operational 
Phases  should  include  a  series  of  dynamic  elements  to  be  accomplished  in  a  timely  and 
technically  acceptable  manner.  The  plan  is  to  include  the  basic  approach,  implementa¬ 
tion  guidelines,  and  methods  for  its  accomplishment.  In  line  with  the  integr  ating  asp  ids 
of  the  system  and  cost  effectiveness  technology,  such  a  plan  should  be  responsive  to 
the  outputs  of  the  multi-specialty  disciplines  affected.  For  the  effectiveness  monitoring 
program  to  be  efficient,  fundamental  features  must  be  incorporated.  These  include 
(1)  simplicity  in  implementation,  (2)  technical  sufficiency,  (3)  flexibility  so  that  critical 
and  sensitive  design  areas  which  are  rotating  with  time  can  be  highlighted,  (4)  maximum 
utilization  of  existing  data,  and  (5)  non-duplication  with  other  complementary  pilans, 
except  on  a  top  summary  level. 

As  a  part  of  the  plan  for  monitoring  effectiveness  progress,  an  efficient  system  is  to 
be  defined  for  the  regular  assessment  of  technical  progress  in  meeting  system  perform¬ 
ance  parameter  requirements  and  goals  throughout  the  Acquisition  Phase.  The  system 
should  be  planned  with  observant  care  of  the  following  practical  realities: 

•  The  status  of  an  FOM  value  and  the  value  for  each  of  its  effectiveness  param¬ 
eters  of  availabiility,  dependability,  and  capability  normally  cannot  be  directly 
tracked.  These  are  composite  values,  determinable  through  analytical  calcula¬ 
tions.  In  contrast,  the  system  parameters,  first-level  parameters,  and  account¬ 
able  factors  are  directly  tractable  in  that  they  represent  the  measurable,  terminal 
performance  cna  racteristics  of  a  system  and  its  constituent  subsystems. 

•  Only  parameters  and  accountable  factors  critical  to  the  performance  and  cost 
effectiveness  of  a  system  are  to  be  tracked. 

a  Technical  performance  measurement  and  tracking  of  critical  parameters  and 
accountable  factors  is  a  dynamic  process,  wherein  each  element  may  rotate  in 
time  with  respect  to  its  criticality.  Thus,  a  critical  parameter  should  be  reduced 
in  stature  to  a  non-critical  parameter  and  deleted  from  the  tracking  system 
it  its  target  has  been  achieved  and  is  not  expected  to  be  altered  with  anticipated 
design  changes. 
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A  necessary  entity  of  a  technically  sufficient  monitoring  plan  on  effectiveness  progress 
and  growth  is  a  system  for  the  meaningful  measurement  of  progress  in  meeting  target 
values  for  the  system  performance  parameters  Such  a  system  is  defined  as  a  Tech¬ 
nical  Performance  Measurement  (TPM)  system.  Elements  to  be  included  on  a  prelimi¬ 
nary  basis  in  a  TPM  system,  consistent  with  the  amount  of  design  details  and  configu¬ 
ration  definition  available  during  the  Definition  Phase,  include- 

#  Master  list  of  parameters  and  accountable  factors  to  be  tracked.  Table  4-5 
provides  examples  of  such  items. 

e  Planned  convergence  profile  for  each  parameter  and  accountable  factor  listed. 
As  a  minimum,  an  estimate  of  the  current  performance  value  at  the  start  of 
development,  and  the  planned  value  at  the  time  of  system  delivery,  are  to  be 
included, 

•  Format  for  reporting  of  status  on  the  current,  planned,  and  demonstrated 
parameter  values  achieved  and  assigned,  such  as: 

(1)  Parameters  and  accountable  factors  from  the  master  list  which  are  to 
be  reported  to  the  procuring  agency.  This  normally  will  involv  3  ton- 
level  and  some  first-level  system  parameters 

(2)  Frequency  of  reporting.  Typical  program  points  for  reporting  are  those 
which  coincide  with  the  planned  SPO  review  of  the  contractor's  integrated 
systems  engineering  and  technical  direction  efforts.  These  SPO  reviews 
are  addressed  to  determining  contractor  progress  and  technical  adequacy 
in  meeting  system  requirements,  including  effectiveness  considerations. 
Typically,  these  points  are  the  system  requirements  reviews,  pre¬ 
liminary  design  reviews  (PDR),  cri*ical  design  reviews  (CDR),  first 
article  configuration  inspection  (FACI),  acceptance  tests,  and  TADs. 

(3)  Approach  for  highlighting  current  and  anticipated  critical  problem  areas, 
and  the  nature  of  problem  analysis  summaries  to  be  presented. 

(4)  Approach  for  filtering  of  design  changes  affecting  the  parameters  and 
factors  on  the  master  list. 
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TABLE  4-5  EXAMPLES  OF  CANDIDATE  PARAMETERS  FOR  INCLUSION 
IN  A  TECHNICAL  PERFORMANCE  MEASUREMENT  SYSTEM* 


Mission 

•  Basic  long  range  mission 

•  Basic  payload  mission  with  specified  g  load  factor 

•  Maximum  payload  mission  with  specified  g  load  factor 

•  Re-supply  mission 


System  and  First- Level  Parameter 

•  Liftoff  weight 

a  Takeoff  distance 

•  Rite  of  climb  (gear  up) 

•  Initial  cruise  altitude 
a  Cruise  speed 

•  Payload 

•  Range 

•  Empty  weight 

a  Operating  weight 

•  Operating  weight  center  of  gravity 

•  Takeoff  drag 

•  Cruise  drag 

•  landing  drag 

•  Takeoff  maximum  lift  coefficient 

•  Landing  maximum  lift  coefficient 

•  Installed  takeoff  thrust 

•  Installed  climb  thrust 

•  Installed  cruise  thrust 

•  Maximum  reverse  thrust 

•  Installed  cruise  thrust  specific 

fuel  consumption 

•  Abort  reliability 

a  Mission  reliability 

•  Maintainability 

•  Organizational  level  maintenance 

manhours 

•  Depot  level  maintenance  manhours 

•  Field  level  maintenance  manhours 


•  Inspection  time 

•  Safety 

•  Quick  engine  change  time 

•  Preventive  maintenance  time 

•  Corrective  maintenance  time 

•  Structural  limit  weight  at  specified 

load  factor 

•  Fuel  capacity 

•  Roll  in  one  second 

•  Air  minimum  control  speed 

•  Roll  helix  angle 

•  Lateral  -  directional  damping 

•  Longitudinal  short  period  damping 

•  Aerodynamic  center  of  gravity  limit 

•  Stall  pattern  indicator  —  cruise 

•  Stall  pattern  indicator  -  takeoff 

•  Stall  pattern  indicator  -  landing 

•  Cooper  rating  (no  augmentation), 

lateral-di  rectional 

•  Cooper  rating  (no  augmentation), 

longitudinal 

•  Uninstalled  thvust 

a  Temperature  in  flight 

•  Flotation 

•  Electric  load  (cruise,  takeoff, 

climb,  emergency) 
a  Hydraulic  )•’  d  (takeoff,  approach) 
a  Turnaround  time 


♦Examples  are  based  on  an  aircraft  system.  Measurement  of  each  parameter  is 
to  be  accomplished  based  on  specific  operating  conditions  (e.g. ,  altitude,  weight, 
center  of  gravity,  temperature,  etc.). 
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(5)  Approach  and  method  for  obtaining  current  and  planned  parameter 

and  accountable  factor  values.  Data  sources  potentially  useful  in 

ebiimi.ting  the je  values  include; 

(a)  planned  design  changes,  with  projected  effect  of  changes  based 
on  sensitivity  relationships  developed  in  Step  E10.  Example.' 

of  types  of  sensitivity  relationships  which  can  be  applied  to  arrive 
at  predicted  parameter  values  £re  listed  in  Table  4-6. 

(b)  credible  design  analyses 

(c)  simulation  tests 

(d)  Category  I  and  II  tests 

(e)  historical  learning  curves  appropriately  adjusted 

(6)  Reporting  form 

Effectiveness  Demonstration  Planning 

As  previously  indicated,  a  system  FOM  normally  cannot  in  itself  be  physically 
demonstrated.  The  notion  of  effectiveness  demonstration,  of  necessity,  refers  to  a 
physical  demonstration  of  the  measurable  performance  parameters  of  a  system,  with 
the  observable  results  analytically  composited  to  arrive  at  a  demonstrated  FOM  value. 
Demonstration  planning  during  Definition,  therefore,  is  to  be  responsive  to  this  reality. 
It  also  is  to  incorporate  a  basic  effectiveness  demonstration  approach  which  utilizes 
the  standard  Category!,  II,  III,  and  TAD  testsplanned  for  the  system. 

Effectiveness  demonstration  planning  involves  the  following  activities: 

•  Identification  from  the  integrated  test  plan  of  those  defined  Category  I,  n,  III, 
and  TAD  tests  which  can  be  considered  to  be  system  tests  representative  of 
the  operational  environment,  and,  therefore,  suitable  to  be  used  for  demon¬ 
stration  purposes 

•  Definition  of  the  interrelation  of  demonstration  tests  v'hicb  may  be  planned 
separately  for  programs  of  related  specialty  disciplines,  such  as  reliability, 
safety,  maintainability,  human  performance,  etc. ,  and  the  approach  fur  heir 
integration 
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TABLE  4-6  EXAMPLES  OF  SENSITIVIT  Y  RELATIONSHIPS  FOR 
PREDICTED  PERFORMANCE 

•  (X)  change  in  takeoff  maximum  lift  coefficient  =  (-y)  feet  takeoff 

distance 

•  (X)  counts  cruise  drag  =  (-y)  pounds  payload 

•  (X)  percent  thrust  specific  fuel  consumption  =  (-y)  pounds  payload 

•  (X)  pounds  liftoff  weight  =  (+y)  pounds  payload 

•  (X)  pounds  liftoff  weight  =  (+y)  feet  takeoff  distance 

•  (X)  pounce  liftoff  weight  =  (-y)  feet  per  minute  rate  of  climb 

•  (X)  pounds  liftoff  weight  -  <-y}  feet  initial  cruise  altitude 


•  Definition  of  the  approach  for  integrating  Category  III  tests  by  the  using 
commands  and  TAD  tests 

•  Establishment  of  the  approach  for  integrating  compatibility  testa  conducted 
with  augmenting  systems 

•  Analysis  of  the  tests  planned  for  the  evaluation  of  system  performance  to 
determine  sufficiency  of  the  planning  for  demonstration  purposes.  Also, 
analysis  of  the  estimating  problem  associated  with  establishing  confidence 
limits  for  FOMs  and  system  parameters,  including  a  description  of  the 
approach  to  be  used.  One  such  approach  is  the  technique  using  Mellin 
transform  and  a  Bayesian  procedure  to  determine  the  output  probability 
distributions  for  products  of  parameters  with  known  input  distributions. 

This  technique  is  described  in  the  RADC  System/Cost  Effectiveness  Notebook. 

Procedure 

The  procedure  for  the  technical  accomplishment  of  the  effectiveness  progress  monitor¬ 
ing  and  demonstration  planning  activity  can  be  summarized  by  the  following  general 
activities : 

•  Establish  a  basic  effectiveness  monitoring  plan,  including  the  approach 
for  a  TPM  system 

•  Establish  preliminary  master  list  of  system  parameters  and  accountable 
factors  which  are  to  be  tracked  during  Acquisition  and  Operational  Phases. 
Correlate  list  with  PBS  elements 

•  Establish  expected  convergence  profile  for  these  parameters  and  account¬ 
able  factors 

•  Establish  monitoring  points  where  effectiveness  progress  is  to  be  formally 
assessed 

•  Identify  the  system  parameters  to  be  demonstrated,  and  the  method  by  which 
the  results  are  to  be  integrated  to  calculate  a  demonstrated  FOM  value 

•  Establish  implamentation  guidelines,  and  identify  data  sources  and  methods 
for  obtaining  measures  of  current,  predicted,  and  targeted  values 
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•  Establish  effectiveness  status  reporting  format  to  include  frequency  of 
updating,  approach  to  highlighting  critical  problem  areas,  and  method  for 
displaying  the  current  and  historical  convergence  progress  of  a  parameter 
value  to  its  target  value  for  each  critical  item  on  the  parameter  list 

•  Define  an  effectiveness  demonstration  plan  to  include  suitable  tests  from 
the  planned  standard  test  programs  which  are  to  be  used  as  demonstration 
tests.  Analyze  sufficiency  of  this  test  planning  with  respect  to  the  number 
of  tests  scheduled  and  test  balance  of  the  critical  system  parameters  to  be 
demonstrated,  and  establish  approach  for  determining  confidence  limit 
estimates. 

Information  Flow 

The  basic  data  required  for  the  effectiveness  progress  monitoring  and  demonstration 
planning  activity  are: 

•  The  parameters  and  accountable  factors  and  their  relative  criticality  com¬ 
posited  in  the  effectiveness  criticality  matrix,  the  sensitivity  relationships, 
and  transfer  functions  from  the  effectiveness  analysis  updating  activity. 

These  data  will  provide  the  rationale  for  the  formulation  of  the  master 
parameter  list,  convergence  profiles,  and  selection  of  system  parameters 
to  be  demonstrated 

•  The  specification  performance  values  from  the  system  performance  specification 
and  the  detail  major  CEI  specifications.  These  values  were  developed, 
allocated,  and  validated  previously  by  the  apportionment  analysis  activity 

•  Information  from  the  system  program  management  and  schedule  networks  for 
establishment  of  formal  reporting  and  review  points 

•  Category  I  and  II  test  plan,  and  the  TAD  and  Category  in  test  plan,  if 
available 

•  Demonstration  plans  for  the  related  specialty  technical  parameters,  such 
as  reliability,  safety,  maintainability,  human  performance,  etc. 
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The  outputs  of  this  activity  will: 

•  Provide  the  detail  data  requirements  for  effectiveness  analyses  to  be 
accomplished  during  Acquisition 

•  Define  the  continuing  effectiveness  evaluations  required  during  Acquisition 

•  Afford  a  perspective  of  th  j  p s  ramete’rs  with  a  high  technical  risk,  and 
the  rate  of  expected  achievement  of  the  target  values  for  ther^e  and  other 
parameters  on  a  time  basis 

•  Provide  an  analysis  of  the  system  test  plan  in  terms  of  usability  for  current 
and  demonstrated  performance  estimates 

•  Form  a  basis  for  performance  incentive  provisions. 

Figure  4-5  summarizes  the  information  network  for  the  effectiveness  progress 
monitoring  and  demonstration  planning  activity. 


4.5  REPORT  |  Step  E12  | 

General 

A  final  report  is  to  be  submitted  to  the  SPO  summarizing  the  system  and  cost  effective¬ 
ness  formulation,  evaluation,  and  assurance  planning  results  for  the  Contract  Defini¬ 
tion  Phase,  The  report  will  be  used  by  system  planners  at  HQ  USAF,  HQ  AFSC,  and 
the  SPO,  for  many  purposes  including  the  following: 

•  To  provide  a  basis  for  the  synthesir  of  the  best  features  of  each  contractor's 
design  approach  into  an  optimum  system  within  the  overall  performance, 
cost,  and  schedule  requirements  and  proprietary  limitations 

•  To  establish  the  traceability  of  design  requirements,  and  to  validate  the 
sufficiency  of  performance  requi  ’-ements  included  in  the  system  specification 
and  the  Part  1  detail  specifications  towards  defining  a  system  with  optimum 
performance  and  cost  effectiveness  to  meet  mission  objectives 

•  To  establish  the  high  technical  and  cost  risk  areas  requiring  focus  and  detail 
design  and  effectiveness  analysis  during  Acquisition  Phase 
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•  To  have  realistic  data  for  updating  of  the  TDP  and  for  the  preparation  of 
the  Proposed  System  Package  Plan  (PSPPi,  which  signifies  that  the  decision 
to  proceed  with  Acquisition  can  be  made 

•  To  provide  the  reference  framework  and  a  continuum  for  the  effectiveness 
activities  to  be  implemented  during  Acquisition  Phase 

The  system  and  cost  effectiveness  report  is  to  include  the  following  updated  technical 
data: 

•  The  mission  analysis  results,  including  descriptions  of  the  specific  objectives 
of  the  mission  and  mission  threats  anticipated  by  kinds,  levels,  and  prob¬ 
ability  of  occurrence 

•  Explicit  definition  of  the  principal  FOMs,  their  technical  traceability  to 
specific  system  performance  parameters  composited,  and  quantitative  values 
for  each  defined  FOM  and  sub-FOM 

•  Expanded  system  performance  requirements  profile,  including  parameters 
taken  into  account  ai  d  their  assigned  values 

•  Expanded  system  operational  requirements  profile,  including  parameters 
taken  into  account  and  their  assigned  values,  maintenance  concepts,  logistics 
support  concepts,  personnel  estimates  by  specialty  skills,  training  concepts, 
transportation  concepts,  etc. 

•  Results  of,  and  rationale  for,  effectiveness  parameter  selection,  including 
criticality  matrix 

•  Models  and  submodels  used  in  the  evaluation  of  FOM,  sub-FOM,  availability, 
dependability,  capability,  cost,  and  cost  effectiveness  measures,  including 
explicit  rationale  and  justification  of  analysis  assumptions 

•  Major  sensitivity  relationships  of  each  defined  FOM  to  its  critical  accountable 
factors 

•  Transfer  functions  for  the  system  level  and  subsystem  level  of  functions  in 
terms  of  output  system  parameters 

•  Descriptions  of  defined  system  states,  state  flow  graphs  as  appropriate,  and 
probability  estimates  for  each  defined  state 


4-43 


•  Tubulated  analysis  results  of  current  estimates  for  FOMs,  sub-FOMs, 
effectiveness  parameters  and  critical  system  parameters 

•  Data  requirements  and  sources  for  Definition  analyses  accomplished  and 
those  contemplated  for  use  in  the  Acquisition  Phase 

■  Description  of  apportionment  technique  used  and  apportionment  results 
on  FOMs,  sub-FOMs,  effectiveness  parameters,  and  critical  system 
parameters 

•  Effectiveness  progress  monitoring  and  demonstration  plan,  including  master 
list  of  parameters  for  TPM,  expected  convergence  profile  for  these  param¬ 
eters,  and  demonstration  test  planning  evaluation  results. 

Information  Flow 

All  of  the  major  activities,  Steps  E9  -  Ell,  will  provide  inputs  to  the  System  and  Cost 
Effectiveness  Report  for  the  Definition  Phase.  The  technical  data  to  be  included  in 
the  report  are  directly  usable  for  the  preparation  of  the  PSPP  and  other  baseline 
documents  needed  to  commence  Acquisition.  The  basic  information  network  for  the 
report  activity  is  shown  in  Figure  4-6. 
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Chapter  5 

SYSTEM  AND  COST  EFFECTIVENESS  IMPLEMENTATION 
FOR  ACQUISITION  PHASF 


Summary 

The  evolutionary  system  and  cost  effectiveness  implementation  process  is  continued 
into  the  Acquisition  Phase  to  provide  Air  Force  and  contractor  management  with 
visibility  and  confidence  of  technical  progress  in  meeting  the  defined  effectiveness 
requirements  and  goals  as  system  design  natures.  During  this  phase,  the  effective¬ 
ness  process  is  addressed  to  the  activities  of  (1)  detail  effectiveness  analysis,  (2) 
effectiveness  progress  monitoring  and  demonstration,  and  (3)  final  report.  The  de¬ 
tail  effectiveness  analysis  activity  provides  a  continuing,  updated  evaluation  of  the 
effectiveness  impact  from  synthesis  being  accomplished  on  design  solutions,  and  the 
extent  that  system  performance  will  be  responsive  to  the  established  effectiveness 
requirements  and  goals.  The  effectiveness  progress  monitoring  and  demonstration 
activity  implements  the  plan  defined  during  Definition,  This  activity  provides  the 
overview  of  technical  progress  on  effectiveness  growth,  critical  risk  and  problem 
areas,  and  achieved  effectiveness  performance  at  major  milestone  points,  and  employs 
a  technical  performance  measurement  system  to  achieve  its  purpose.  The  final  re¬ 
port  activity  provides  to  the  SPO  a  closing  summary  of  the  significant  effectiveness 
progress  achieved  during  the  phase.  The  basic  time-sequenced  format  used  to  de¬ 
scribe  the  effective  less  activities  of  the  Definition  phase  and  their  interactions  with 
the  system  management  procedures  of  AFSCM  375-4  on  a  composited  basis  is  pre¬ 
served  for  the  description  of  the  activities  and  procedures  applicable  to  the  Acqui¬ 
sition  Phase. 


5-1  GENERAL 


The  Acquisition  Phase  consists  of  two  overlapping  efforts  of  development  and 
production.  The  phase  starts  with  the  issue  of  the  System  Program  Directive  and  the 
preparation  of  the  System  Program  Package  (SPP).  It  ends  with  the  acceptance  of  the 
last  operating  unit  by  the  using  command  or  organization,  and  when  all  changes  re¬ 
quired  from  Category  n  testing  have  been  placed  on  contract.  The  fundamental  pur¬ 
pose  of  this  phase  is  to  acquire  and  test  the  system  elements  required  to  satisfy  the 
SPP  and  the  system  specification.  The  Acquisition  Phase  is  intended  to  achieve  the 
following  objectives: 

(a)  Updating  detail  plans  derived  during  the  definition  phase. 

(b)  Identification  of  spares  required. 

(c)  Verification  of  Part  I  Detail  Specifications  and  Inventory  Equipment 
Requirement  Detail  Specifications. 

(d)  Accomplishment  of  preliminary  and  detail  design,  and  performance  of 
design  reviews. 

(e)  Establishment  of  configuration  of  the  system  in  terms  of  audited  and 
approved  Part  n  Detail  Specifications, 

(f)  Beginning  of  production  and  construction. 

(g)  Preparation  of  procedural  publications. 

(h)  Performance  of  Categories  I  and  II  and  any  follow-on  development  testing. 

(i)  Definition  of  logistic  requirements  in  detail. 

(j)  Preparation  for  transition  of  system  management  from  AFSC  to  AFLC . 

..  (k)  Preparation  for  turnover  of  the  system  to  the  using  command  or  organization. 

The  technical  nativities  of  the  effectiveness  process  to  be  implemented  during  this 
phase  will  contribute  to  the  achievement  of  objectives  (a),  (b),  (c),  (d),  (e),  and  (i). 
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Implementation  of  the  system  and  cost  effectiveness  process  during  Acquisition  is 
directed  at  the  following  basic  purposes: 

•  To  provide  current  and  predicted  estimates  of  system  and  cost  effectiveness 
on  a  continuing  basis  as  significant  design  details  are  developed  on  product 
configuration,  or  as  performance  requirements  are  changed. 

•  To  provide  a  current  assessment  of  technical  progress  in  meeting  require¬ 
ments  and  goals  on  effectiveness-related  parameters  and  measures. 

•  To  provide  the  SPO  with  a  compendium  of  the  final  effectiveness  baseline 
used  for  analyses,  the  achieved  versus  required/target  .id  effectiveness,  and 
the  system  improvement  potentials  for  effectiveness  growth. 

The  principal  uses  of  the  effecti  veness  process  outputs  are: 

•  To  T*ide  trade-off  decisions. 

9  1  c  establish  system/subsystem  traceability  and  validation  of  parameters 

effecting  system  and  cost  effectiveness. 

•  To  evaluate  current  and  predicted  system  and  cost  effectiveness  status  as 
design  progresses  to  insure  the  evolution  of  a  system  tlw.fc  will  meet  the  de¬ 
fined  requirements  and  ^oals  for  an  optimum  cost,  performance,  and  time 
balance. 

m  To  reapportion  effectiveness  and  system  parameters  as  needed  for  optimum 
cost-performance-time  balance. 

•  To  provide  management  visibility  of  technical  progress  on  effectiveness 
growth,  critical  problems,  and  high  risk  areas  requiring  timely  attention 
through  effectiveness  analyses. 

•  To  demonstrate  effectiveness  performance  results  under  operational 
conditions . 

•  To  determine  whether  effectiveness  requirements  and  goals  have  been 
met . 

•  To  assess  the  extent  that  operational  tactics  are  affected  by  final 
effectiveness  results . 

9  To  validate  areas  requiring  engineering  modifications. 
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The  system  and  cost  effectiveness  process  during  the  Definition  Phase  was  addressed 
to  the  definition  of  the  effectiveness  formulation,  evaluation.and  assurance  baseline  for 
the  Acquisition  Phase.  Elements  defined  in  detail  include  (1)  effectiveness  and 
effectiveness- related  measures,  (2)  critical  parameters  and  accountable  factors  in¬ 
fluencing  these  measures,  (3)  sensitivities  and  relationships  of  the  influences  under 
operational  conditions,  and  methods  for  their  measurement,  '1)  achievable  and  firm 
performance  requirements  to  be  included  into  the  system  specification  and  Part  I  of 
detail  specifications  for  optimum  system  effectiveness,  (5)  effectiveness  analysis 
models,  (6)  data  requirements  for  the  analyses  to  be  accomplished,  and  (7;  progress 
monitoring  and  demonstration  plan.  Additionally,  current  estimates  for  the  defined 
effectiveness  measures  were  prepared  to  guide  perforriance-cost-time  tradeoff  de¬ 
cisions,  shape  preliminary  design  solutions,  focus  the  expected  performance  efficiency 
and  economy  of  the  defined  system  configuration,  and  highlight  the  technical  and  cost 
risk  areas  requiring  special  attention  and  resolution  during  system  development. 

The  evolutionary  system  and  cost  effectiveness  process  is  continued  into  the  Acquisi¬ 
tion  Phase  to  provide  an  authoritative  perspective  of  the  technical  progress  towards 
meeting  the  defined  effectiveness  requirements  and  goals  as  design  details  are  de¬ 
veloped  on  product  configuration.  The  activities  required  are  summarized  by  the 
following  implementation  steps: 


Step  E13  -  Detail  Effectiveness  Analysis 


This  activity  refines  the 


analysis  baseline.  It  includes  (1)  model  changes,  (2)  parameter  re-selection, 
(3)  more  precise  definition  of  the  FOM  measures,  operational  conditions,  and 
technical  FOM  traceability  and  representation,  (4)  reapportionment  of 
effectiveness-sensitive  parameters,  (5)  reassessment  of  data  requirements, 
and  (6)  similar  planning  factors  for  valid  analyses.  Additionally,  this  activity 
provides  a  continuing  series  of  effectiveness  evaluations  concomitant  with  the 
development  of  the  product  configuration. 
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|  Step  E14  -  Effectiveness  Progress  Monitoring  and  Demonstration 


This  activity  provides  management  with  the  needed  visibility  of  the  technical 
progress  on  effectiveness  growth,  critical  problems  and  continuing  risk  areas, 
and  achieved  effectiveness  performance  at  major  milestone  points.  This  is 
accomplished  with  a  dynamic  technical  performance  measurement  program 
and  through  use  of  selected  test  results. 


Step  E 15  -  Final  Report  This  activity  provides  a  report  that  summarizes 


the  significant  results  of  the  effectiveness  formulation,  evaluation, and 
assurance  activities  implemented  during  the  Acquisition  Phase,  including 
(1)  the  updated  baseline  used  for  analyses, (2)  comparison  of  the  final  meas¬ 
ured,  projected,  and  demonstrated  effectiveness  values,  (3)  an  analysis  of 
the  operational  implications  of  the  results,  and  (4)  system  improvement 
potentials  for  future  effectiveness  growth. 


System  effectiveness  requirements  and  targets  normally  will  be  specified  in  the  SOW, 
the  system  specification,  and  Part  I  of  detail  specifications.  Typical  requirements 
for  inclusion  in  these  documents  for  execution  by  the  selected  integrating  and  associ¬ 
ate  contractors  are: 

i»  Updating  of  effec  tiveness  analysis  baseline,  specifically  to  include  re- 
evaluation  of  effectiveness  parameter  selection,  the  effects  of  parameter 
requirement  changes  on  the  effectiveness  FOM,  and  modifications  to  models 
provided  or  approved  by  the  procuring  activity. 

•  Refinement  on  a  continuing  basis  of  system  and  cost  effectiveness  analyses, 
including  availability,  dependability,  and  capability  analyses,  with  the 
analysis  results  to  be  made  available  for  review  by  the  procuring  activity  at 
specified  development  and  production  milestones,  such  as  PDR,  CDR,  FACI, 
Category  II  testing,  and  Technical  Approval  Demonstrations  (TADs). 

•  Preparation  of  computerized  analysis  routines  to  a  specified  computer 
language  and  format  as  applicable. 
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•  Control  of  effectiveness  model  changes  affecting  configuration-effectiveness 
relationship  as  Class  1  changes  subject  to  the  change  control  procedures  of 
AFSCM  375-1. 

•  Coordination  of  guides  and  standards  for  the  accomplishment  of  subcontrac¬ 
tor  analyses. 

•  Updating  and  implementation  of  a  dynamic  effectiveness  progress  monitoring 
and  statusing  program,  to  include  a  technical  performance  measurement 
system  and  a  systematic  procedure  for  isolating  design  changes  with  major 
effectiveness  implications. 

•  Updating  and  implementation  of  an  effectiveness  demonstration  plan. 

e  Final  reporting  of  analysis  results. 

The  effectiveness  process  to  be  implemented  during  the  Acquisition  Phase  is  compatible 
with,  interacts,  and  supports  both  the  system  program  management  and  systems 
engineering  management  procedures  as  defined  in  AFSCM  375-4  and  375-5,  respectively. 
The  three  processes  have  complementary  activities  for  translating  detail  design  re¬ 
quirements  into  optimum  performance-cost-time  solutions  within  sensible  risk  allow¬ 
ances.  An  overview  of  the  relationships  and  interactions  was  provided  in  Figure  2-3 
in  Chapter  2. 


5-2  DETAIL  EFFECTIVENESS  ANALYSIS 


Step  Eli] 


General 

The  principal  product  of  the  Acquisition  Phase  is  the  acceptance  of  a  total  system  which 
is  capable  of  performing  the  intended  mission  in  the  operational  environment.  The  phase 
begins  with  the  PSPP  revised  to  reflect  any  changes  required  by  the  System  Program 
Directive  and  converted  into  the  System  Package  Program  (SPP),  the  master  plan  for 
this  phase.  Preliminary  detail  design  is  then  initiated  by  the  Acquisition  contractor. 

This  preliminary  design  is  to  assure  that  the  design  approach  selected  is  acceptable 
to  satisfy  the  specified  requirements  of  the  SOW,  the  system  specification,  Part  I  of 
detail  specifications,  and  other  baseline  documents.  Subsequently,  engineering 
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definition  continues  throughout  this  phase  until  the  system  has  been  described  by 
Part  II  detail  specifications  and  drawings.  As  additional  detailed  design  information 
becomes  available,  such  as  from  test  results,  changes  to  existing  requirements  may 
be  required. 

The  detail  effectiveness  analysis  activity  is  addressed  to  a  companion  and  continuing 
definition  and  critical  evaluation  of  the  impact  to  effectiveness  of  the  synthesis  being 
accomplished  on  alternate  design  solutions,  and  the  extent  that  the  detail  design  being 
developed  will  be  capable  of  meeting  the  established  system  effectiveness  require¬ 
ments  and  goals.  Effectiveness  definition  and  analysis  results  requiring  continuous 
updating  and  refinement  include  the  following  activities  initiated  during  Concept 
Formulation  and/or  Definition: 

•  Mission  analysis 

•  Principal  FOM  and  sub-FOM  technical  traceability  and  correspondence 
to  functional,  specialty,  and  operational  parameters 

•  Performance  requirements  analysis 

•  „  Operational  requirements  analysis 

•  Effectiveness  parameter  selection 

•  Model  and  sub-model  structuring 

•  System  and  cost  effectiveness  analysis 

•  Apportionment  analysis 

■  Progress  monitoring  and  demonstration  planning 
Mission  Analysis 

The  refinement  of  the  mission  analysis  is  addressed  primarily  to  improving  the 
definition  of  the  specific  objectives  for  the  mission  by: 

•  Incorporation  of  latest  intelligence  information  on  the  kind,  magnitude, 
le''el,  and  probability  of  enemy  threats  expected  to  be  present  at  the  time 
of  initial  operational  deployment,  and  at  a  time  five  years  in  the  future. 


•  A  more  accurate  quantitative  definition  of  the  terminal  performance 
parameters  to  be  achieved  by  the  system  as  evidence  that  the  specific  mis¬ 
sion  objectives  are  met,  including  the  specification  of  a  minimum,  maximum, 
or  range  of  required  or  targeted  values  for  the  parameters. 

•  A  more  precise  definition  based  on  design  details  being  developed  of  the 
system  neutralising  capabilities  and  limitations  to  counteract  enemy  threats, 
including  the  capabilities  of  augmenting  systems  which  may  be  planned  for 
simultaneous  employment  in  the  mission,  avoidance  tactics  to  take  advantage 
of  special  system  characteristics,  and  other  countermeasures.  Analytical 
techniques,  such  as  computer  simulations,  can  be  used  to  obtain  a  penetra¬ 
bility  and/or  vulnerability  profile  as  a  probability  function  of  time,  threat 
levels,  angle  of  attack,  altitude,  and  similar  dependent  variables. 


Principal  FOMs 

The  values  for  FOM  measures  defined  at  the  conclusion  of  Definition  are  not  expected 
to  change  for  the  Acquisition  Phase.  However,  a  more  precise  definition  is  required 
of  the  specific  system  parameters  composited  by  the  effectiveness  parameters  of 
availability,  dependability,  and  capability  that  critically  influence  each  FOM  measure, 
and  the  technical  logic  by  which  each  FOM  relates  to  these  system  parameters  and 
their  sett:  of  critical  accountable  factors.  A  similar  refinement  in  definition  will  be 
needed  for  each  sub-FOM  developed. 

Performance  Requirements  Analysis 

First-level  system  functions  previously  defined  normally  will  not  change  during 
Acquisition.  Second-level,  subsystem  functions,  however,  may  change  as  a  result 
of  trade-off  studies  to  investigate  alternate  means  of  accomplishing  the  tasks,  con¬ 
sistent  with  the  product  configuration  being  developed  and  resource  restrictions.  A 
refinement  of  the  time-based,  operational  requirements  profile  will  be  required  to 
include  the  definition  of  (1)  specific  first  and  second-level  functions  influencing 


effectiveness,  (2)  the  set  of  corresponding  system  and  subsystem  parameters  that 
can  be  measured  us  evidence  of  successful  accomplishment  of  these  functions,  (3) 
quantitative  values  and  tolerances  for  the  parameters,  and  (4)  the  natural  environ¬ 
mental  spectrum  associated  with  each  function. 

Operational  Requirements  Analysis 

A  corresponding  updating  and  refinement  rl  the  system  operational  requirements 
profile  (and  as  necessary,  the  system  and  CEI  specifications)  are  accomplished 
based  on  detail  data  developed  from  the  following  systems  engineering  activities: 

•  Trade-off  studies  of  maintenance,  test,  and  activation  factors  to  determine 
detail  requirements  imposed  by  the  AVE  or  OGE,  MGE,  and  AAE  selected 
during  Definition.  Factors  to  be  analyzed  include  (1)  levels  of  maintenance, 

(2)  quantity  of  equipment,  (3)  estimated  range  and  depth  of  required  spares 
and  spare  parts,  (4)  facility  utilization,  (5)  test  and  activation  equipment, 
and  (6)  total  predicted  costs,  all  of  which  will  influence  operational  param¬ 
eters  defined  in  terms  of  measures  such  as  downtime,  costs,  and  in¬ 
commission  rates. 

•  Development  of  detail  maintenance  functions  and  design  requirements  for 
maintenance  functions,  maintenance  end  items,  facilities,  and  maintenance 
personnel  and  training. 

•  Cost-effectiveness  trade-off  studies  on  maintenance  loading  to  establish  the 
combination  of  equipment,  spares,  and  personnel  required  to  maintain  the 
system  efficiently  and  economically.  Accountable  factors,  such  as  the 
number  of  days  deployed  before  a  unit  is  returned  for  preventive  maintenance, 
the  number  of  units  to  be  deployed  concurrently,  the  hours  of  work  per 
maintenance  personnel,  and  equipment  availability,  are  assessed  as  a  part 

of  these  studies. 

•  Detail  studies  of  transportation  time,  costs,  and  relevant  factors. 

•  Detail  studies  of  intersystem  interfaces,  such  as  combined  reaction  time, 
error  contributions,  survival  time,  and  target  identification  time. 
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•  Studies  of  special  facilities  required  for  achieving  a  required  readiness 
state  for  the  system. 

•  Detail  identification  of  the  natural  environmental  spectrum  expected  to 
be  influential  on  the  operational  parameters. 

Effectiveness  Parameter  Selection 

Refinements  for  the  effectiveness  parameter  selection  activity  is  a  continuous 
process  during  Acquisition  and  is  addressed  to: 

•  A  re-evaluation  for  criticality,  and  a  reselection  as  necessary,  of  the 
output  parameters  for  the  previously  defined  syBtem  and  subsystems  and 
of  the  accountable  factors  for  subsystems  with  defined  sub-FOMs. 

•  A  revision  of  the  transfer  functions  to  obtain  a  more  detailed  and  accurate 
representation  of  the  input-output  relationships  for  the  system  and  subsystem 
functions. 

•  A  further  extension  of  the  transfer  functions  to  lower  design  levels  to  accom- 
mode  „'j  product  configuration  trade-off  analyses  for  arriving  at  the  required 
inputs  for  the  critical  accountable  factors, 

•  A  revision  of  sensitivity  functions  based  on  detailed  analytical  studies  and  test 
results. 

•  A  revision  of  the  normalized  sensitivity  coefficients  included  in  the  criticality 
matrix  based  on  detail  analysis  and  test  results. 

Model  Structuring 

The  system  and  cost  effectiveness  submodels  will  change  as  a  result  of  any  system 
performance  parameter  reselections.  Additionally,  other  model  changes  will  be  re¬ 
quired  on  a  continuous  basis  to  insure  an  accurate  measure  of  mission  objective 
accomplishment  in  terms  of  measurable  system  performance  parameters.  Typically, 
the  following  refinements  will  be  -caded: 

e  Continuous  re-examinatlon,  verification,  and  modification  of  assumptions, 
and  reduction  of  other  analytical  error  sources  to  increase  model  precision 
based  upon  current  design  details,  more  penetrating  analytical  studies,  and 
test  results. 
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•  Validation  and  expansion  of  the  defined  system  states,  ano  further  definition 
of  the  state  progression  logic.  Table  5-1  shows  a  typical  progression  logic 
for  establishing,  expand  Lag,  and  defining  system  states  during  Acquisition, 
and  the  evolution  linkups  of  these  states  to  those  defined  in  earlier  phases. 
For  most  applications,  the  system  operating  conditions  that  can  influence 
effectiveness  are  reducible  to  three  conditions.  These  are  the  conditions 
of  fully  operable,  fail-operable  (partially  operable),  and  inoperable.  Of 
these  three  conditions,  only  the  fall -operable  condition  should  be  divided 
into  different  system  states.  From  the  viewpoint  of  evaluating  the  effect 
of  different  system  states  on  an  FOM  measure  (and  hence,  on  the  fulfillment 
of  one  or  more  mission  objectives),  there  is  no  practical  reason  for  dividing 
the  fully  operable  or  inoperable  system  condition  into  different  system  states. 
A  rationale  for  establishing  the  different  divisions  of  state  groups  to  be 
associated  with  the  fail-operable  condition  is  to  define  as  belonging  to  the 
same  state  group  all  system  anomalies  resulting  in  the  same  order  of  mag¬ 
nitude  of  change  to  an  FOM  value  (e.g. ,  ±.05).  For  most  applications,  the 
number  of  divisions  should  not  exceed  five  groups  of  significantly  different 
states.  This  is  concordant  with  the  premise  that  a  larger  number  of  state 
groups  would  be  analytically  unwieldy.  It  would  also  be  incongrous  with  the 
errors  inherently  present  in  approximations  to  transfer  functions  and  in 
estimates  of  initial  ano  transition  probabilities  for  the  defined  states.  Such 
errors  would  not  be  reduced  significantly  by  a  finer  division  of  e<, at’  groups. 

A  procedure  for  establishing  the  different  states  to  apply  to  the  fail-operable 
system  condition  is  as  follov/s: 

(a)  Identify  the  major  sub-functions  for  each  top-level  system  function. 

fb)  Determine  the  output  distribution  for  each  system  parameter  asso¬ 
ciated  with  the  previously  Identified  top-level  system  function  by 
evaluating  the  significant  combinations  of  fail -operable  anomalies 
which  can  arise  v/ith  the  sub-functions  (e.g. ,  simultaneously,  one 
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TABLE  5-1  STATE  PROGRESSION  LOGIC 


Mission 

Operating 

Condition 

Conceptual  Phase 
System 

Operating  System 
Condition  State** 

Definition  Phase 

System 

Operating  System 
Condition  State** 

Acquisition  Phase 

System 

Operating  System 
Condition  State** 

•  Non- 

Fully  1.0 

Fully  1.0 

Fully  1.0 

abort 

operable 

operable 

operable 

Fail-  1.1 

Fail-  1.1.1 

operable* 

operable*  1.1.2 

etc. 

•  Abort 

. 

Inoperable  2.0 

Inoperable  2.0 

Inoperable  2.0 

_ 

*  May  be  denoted  as  "partially  operable." 

**  States  can  be  renumbered  (e.g.,  1,  2,  3,.  .  ,).  An  example  of  State  1,1.1  is 
"one  out  of  four  engines  not  operating. "  This  state  may  be  renumbered  as  State 
No.  2;  State  1.1.2  could  be  defined  as  "two  out  of  four  engines  not  operating, 
one  on  each  side"  and  renumbered  as  State  No.  3*,  etc. 
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sub-function  inoperable,  a  second  sub-function  operable  but  out  of 
tolerance,  and  all  other  sub-functions  in  tolerance).  Relate  a  system 
parameter  output  value  for  each  such  combination.  Use  simulation  or 
direct  calculations  from  the  mathematical  transfer  functions  to  deter¬ 
mine  these  output  values. 

(c)  Calculate  an  FOM  estimate  for  each  output  value.  Categorize  the 
analyzed  combinations  of  sub-function  anomalies  into  practical  broad- 
range  state  groups  based  on  the  FOM  values  thus  determined. 

•  Updating  the  estimates  for  the  probabilities  of  the  system  being  in  a 
specific  initial  state  and  making  a  transition  from  state  to  state.  With 
the  important  failure  combinations  previously  identified  and  categorized 
into  distinct  state  groups,  and  with  results  from  breadboard/development 
tests  properly  translated,  current  estimates  can  be  validly  obtained. 

•  Further  definition  of  the  effectiveness  evaluation  baseline,  including  a 
restructuring  as  needed  of  the  threat  level  groupings  to  reflect  the  latest 
threat  posture  identified  in  the  updated  mission  analysis. 

s  Revision  of  the  system  effectiveness  submodels.  The  submodels  defined 
for  the  effectiveness  parameters  of  availability,  dependability,  and 
capability  will  require  updating  to  reflect  the  Impact  of  new  performance 
requirements  or  parameter  roselections .  Separate  models  used  to  evaluate 
the  critical  system  functional,  specialty,  and  operational  parameters 
composited  by  the  effectiveness  parameters  also  will  require  updating  as 
the  design  details  evolve,  and  as  the  critical  accountable  factors  and  their 
values  are  more  accurately  defined. 
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•  Inclusion  of  a  new  system  parameter,  the  quality  parameter,  to  represent 
the  influence  on  the  FOMs  of  variations  from  the  established  product  con¬ 
figuration  during  production.  The  quality  parameter  will  moderate  the 
level  of  system  availability,  dependability,  and  capability  achievable. 
Typically,  the  quality  parameter  can  be  considered  to  act  as  an  account¬ 
able  factor  for  each  of  these  effectiveness  parameters.  It  can  be  defined 
as  the  probability  of  detecting  a  defect  critically  influencing  system  per¬ 
formance  when  such  a  defect  is  present.,  and  is  a  function  of  factors  such 
as  (1)  the  probability  of  a  set  of  critical  defects  occurring,  (2)  the  proba¬ 
bility  of  detecting  these  defects  when  they  are  present,  (3)  the  sensitivity 
of  the  effectiveness  parameters  to  the  presence  of  those  defects  when  they 
escape  detection,  and  (4)  the,  measurability  and  frequency  (opportunity)  of 
measurement  for  the  defined  defects . 

•  Expansion  of  the  cost  submodels  and  cost  relationships  defined  for  each 
major  category  of  cost.  This  will  provide  increased  precision  and  realism 
to  the  system  cost  model  and  will  allow  detail  cost  trade-offs  to  be  validly 
accomplished  on  high  technical  and  cost  risk  product  areas. 

•  Formulation  of  cost  effectiveness  submodels  that  are  compatible  with  the 
system  cost  effectiveness  models,  rhese  submodels  are  to  be  used  for 
assessment  of  the  major  performance-cost-time  trade-off  alternatives  on 
product  configurations  at  the  subsystem  and  lower  levels. 

•  Re-evaluation  of  the  data  requirements  and  sources  needed  as  model  Inputs 
to  obtain  valid  output  estimates  of  FOMs,  effectiveness  parameters,  system 
parameters,  and  cost  effectiveness  measures  defined  for  the  system  and 
subsystems.  Sources  of  data  expected  to  be  of  major  usefulness  include 
engineering  analytical  studies,  preliminary  and  critical  design  reviews, 
first  article  configuration  inspections  (FACIs),  CEI  and  system/ facility 
acceptance  tests,  system  Category  I  and  II  tests,  technical  approval  demon¬ 
stration  tests  (TADs),  and  the  operational  phase  Category  in  tests. 
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System  and  Cost  Effectiveness  Analysis 

System  and  cost  effectiveness  analyses  will  be  required  on  a  continuous  basis  during 
Acquisition.  Principally,  the  analyses  are  addressed  to: 

•  Refining  the  optimization  of  critical  system  parameters  and  accountable 
factors  to  shape  design  solutions  for  high  risk  areas,  to  validate  changes 
to  performance  requirements  in  the  system  specification  and  to  detail  CEI 
specifications  based  on  their  integrated  effects  on  other  design  criteria, 
also  to  establish  detail  product  design  requirements. 

•  Validating  changes  to  the  original  scope  of  technical  programs,  such  as 
the  reliability  and  maintainability  efforts. 

•  Justifying  engineering  change  proposals  on  the  basis  of  net  effect  to  the 
overall  capability  and  economy  of  the  system. 

•  Developing  information  needed  for  the  system  preliminary  design  reviews, 
(conducted  on  an  incremental  and  integrated  basis  early  in  Acquisition)  to 
assess  the  performance  effectiveness,  economy,  and  feasibility  of  the 
design  approach. 

•  Establishing  from  trade-off  studies  the  cost-effective  detail  requirements 
for  maintenance  elements  of  the  system.  These  elements  include  detail 
maintenance  functions  and  design  requirements,  maintenance  personnel 
and  training,  and  maintenance  facilities.  Typical  trade-off  studies  to 
optimize  these  maintenance  elements  should  include  the  factors  of  main¬ 
tenance  levels,  equipment  quantities,  range  and  depth  of  required  spares 
and  spare  parts,  facility  utilization,  test  and  activation  equipment,  and 
costs . 

•  Updating  of  sensitivity  functions  and  the  criticality  coefficients  to  improve 
their  accuracy  for  use  as  practical  design  guidelines  and  to  provide  detail, 
design  visibility  of  the  influence  that  changes  to  design  requirements  for 
critical  accountable  factors  will  have  on  the  system  parameters  and  FOMs. 


LW 
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•  Providing  current  and  predicted  estimates  for  the  system  and  subsystem 
FOM  measures,  effectiveness  parameters,  and  critical  system  parameters. 
Current  estimates  can  be  prepared  from  the  results  of  engineering  analyses, 
Category  I  tests/verifications  (especially  those  performed  on  the  complete 
system  or  on  broad  assemblages  of  CEIs  and  subsystems),  and  extrapola¬ 
tions  of  historical  data  available  from  Government  data  banks,  contractor 
sources,  or  standard  sources  (e.g.,  MIL-HDBK  217  data  appropriately 
adjusted) ,  Predicted  estimates  of  the  expected  convergence  values  for  these 
measures  and  parameters  can  be  made  based  on  performance  requirement 
changes  or  additional  design  refinements  anticipated  to  be  incorporated  prior 
to  first  delivery  of  the  completely  developed  system.  Current  and  predicted 
values  for  the  system  FOMs  and  parameters  are  to  be  prepared  when  a 
major  design  change  occurs,  when  significant  test  and  evaluation  results 
are  obtained,  and  to  support  sy.r,cem  design  reviews,  FACI,  acceptance  tests, 
and  TADs. 

•  Developing  information  to  support  critical  design  reviews  (CDRa).  This  in¬ 
formation  is  to  include  the  system  and  cost  effectiveness  rationale  and  trace- 
ability  for  the  established  detail  design  and  performance  requirements. 

•  Providing  current  and  predicted  estimates  of  cost  effectiveness  measures 
concurrently  with  the  FOM  and  parameter  estimates  to  assess  the 
performance-cost -time  balance  of.  the  design  being  evolved. 

•  Providing  confideoce  limits  for  each  FOM  and  cost  effectiveness  estimate 
to  reflect  the  precision  of  the  estimates. 

Apportionment  Analysis 

The  branching  of  the  apportionment  process  below  the  second-level  (subsystem) 
accountable  factors  will  be  required  during  Acquisition  to  provide  the  technical  trace- 
ability  of  design  and  performance  requirements  appearing  in  major  CEI  detail  specifi¬ 
cations  and  product  specifications.  The  apportionment  rationale  and  techniques 
described  for  this  activity  during  the  definition  phase  are  equally  applicable  for  this 
extension  of  the  apportionment  process. 
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A  reapportionment  of  the  values  allocated  during  Contract  Definition  to  subsystem 
parameters,  FOMs  (sub-FOMs),  and  accountable  factors  will  be  required  if  new  sub- 
system  constraints  are  surfaced  (from  development  studies)  which  are  neither  cost- 
effective  nor  technically  feasible  to  overcome,  A  readjustment,  therefore,  of  the 
previously  allocated  subsystem  design  criteria  must  necessarily  be  made  based  on 
more  refined  trade-off  studies  to  arrive  at  realistic  and  firmly  achievable  subsystem 
design  requirements. 

Additionally,  top-level  system  parameters  composited  by  the  effectiveness  parameter 
sets  of  availability,  dependability,  and  capability  may  require  cross-reapportionment. 
The  need  for  a  reapportionment  among  these  system  parameter  values  at  this  point  in 
time  may  arise  from  extreme  circumstances,  such  as  new  intelligence  information  of 
enemy  potentials  influencing  system  performance  capability. 

Progress  Monitoring  and  Demonstration  Planning 

Prior  to  the  implementation  of  the  effectiveness  progress  monitoring  plan  defined 
during  Definition,  the  master  list  of  parameters  and  accountable  factors  to  bs  tracked 
during  development,  and  their  expected  convergence  profile,  are  to  be  refined  and 
validated.  This  is  to  insure  that  only  effectiveness-critical  performance  requirements, 
including  high  technical  and  cost  risk  areas,  are  selected  for  inclusion  in  the  Technical 
Performance  Measurement  (TPM)  system.  Alterations  to  the  master  list  and  profiles 
may  occur  aa  a  result  of  refinements,  such  as  reapportioned  and/or  additional  per¬ 
formance  requirements,  re-ordering  of  the  sensitivity  rankings  in  the  criticality  matrix, 
and  revised  learning  curves  based  on  a  better  defined  design  solution.  Additionally,  the 
format  for  reporting  of  status  on  the  current,  planned  (anticipated) ,  and  demonstrated 
parameter  values  achieved  and  assigned,  including  the  approach,  methods,  and  data 
sources  to  be  used  for  arriving  at  current  and  predicted  estimates,  are  to  be  re¬ 
examined  and  updated. 

Similarly,  the  effectiveness  demonstration  plan,  which  is  based  on  demonstrating  the 
extant  to  which  measurable  and  critical  system  parameters  are  met,  is  to  be  updated. 
This  updated  plan  is  to  reflect  the  contractor  plans  for  Categories  I  and  II  testing,  to 
incorporate  the  latest  Category  IH  operational  demonstration  test  planning  by  the  using 
command  or  agency,  and  to  be  responsive  to  the  TADs  planned  for  the  system  Lu  ihe 
operational  environment  as  a  part  of  the  turnover  of  the  system  to  the  using  command 
or  agency.  The  analysis  of  the  sufficiency  of  the  tests  for  demonstrating  system 
effectiveness  and  the  method  by  which  demonstration  test  programs  for  related  efforts 
will  be  integrated  (e.  g. ,  reliability  and  maintainability  tests)  are  to  be  revised  based 
on  the  latest  test  planning  information. 
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Information  Flow 

The  basic  data  required  for  the  detail  effectiveness  analysis  activity  are  available 
from  regular  development  sources.  Most  of  these  sources  are  progressively  updated 
during  Acquisition.  Principal  sources  include  the  following: 

•  SPP  and  the  updated  program  and  design  requirements  baselines. 

•  Definition  Phase  system/cost  effectiveness  reporf. 

•  Program  work  breakdown  and  contractor  work  breakdown  structures. 

•  Detail  design  data.  *  t 

•  System  test  plan. 

•  Results  of  Category  I  tests  and  evaluations . 

•  Updated  engineering  analyses,  RASs,  engineering  trade-off  studies  to 
establish  detail  solution  approaches,  schematic  diagrams,  time  lines, 
maintenance  analyses,  and  the  system  operational  plan. 

The  outputs  of  this  activity  will  contribute  to: 

•  The  updating  and  validation  of  the  system  specification  and  Parts  I  and  II 
of  the  detail  specifications  for  major  CFIs. 

•  The  assessment  of  the  effectiveness  influence  due  to  intersystem  and  intra¬ 
system  interfaces. 

•  The  creation  of  design  solutions  that  are  optimumly  balanced  for  perform¬ 
ance,  cost,  and  time  factors. 

•  The  timely  focusing  of  development  effort  onto  high  technical  and  coat  risk 
areas  impacting  system  and  cost  effectiveness, 

•  The  technical  base  for  conducting  the  effectiveness  progress  monitoring 
and  demonstration  program. 

•  An  integrated  perspective  of  overall  system  performance  capabilities  to 
support  program  elements,  such  as  program  reviews,  requirements  re¬ 
views,  design  reviews,  and  engineering  change  requests. 

•  A  basis  for  better  and  more  timely  system  management  and  systems  en¬ 
gineering  management  decisions. 
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A  summary  of  the  basic  Information  network  for  the  detail  effectiveness  analysis 
activity  is  shown  in  Figure  5-1. 


5-3  EFFECTIVENESS  PROGRESS  MONITORING  AND  DEMONSTRATION  jste;-  L14 
General 

This  activity  implements  the  effectiveness  monitoring  and  demonstration  plan  defined 
during  Definition  and  updated  early  in  Acquisition.  The  activity  places  emphasis  on 
providing  Air  Force  and  contractor  management  with  visibility  and  confidence  of  the 
current,  predicted,  and  proven  program  performance  achievements.  Regular  outputs 
of  the  activity  will  provide  guidance  for  valid  and  timely  decisions  by  project  managers 
addressing  the  integration  of  the  multiple  functional,  specialty,  and  operational  per¬ 
formance  parameters,  and  their  associated  technical  disciplines,  in  support  of  overall 
program  goals. 

This  activity  is  primarily  directed  at  the  preparation  and  issue  of  timely  status  reports 
reflecting  the  achieved  and  anticipated  effectiveness  progress  during  Acquisition.  Tbe 
technical  performance  history  from  the  inception  of  Acquisition,  including  measure¬ 
ments  of  current,  planned  (anticipated),  and  demonstrated  values  of  FOMs,  effective 
ness  parameters,  and  system  parameters,  are  to  be  provided  to  the  SPO  on  a  continu¬ 
ing  basis.  This  information  provides  the  insight  into  the  rate  at  which  design 
solutions  are  converging  onto  the  critical  performance  requirements  or  allocated  values 
on  a  time  basis,  and  those  high  risk  areas  and  technical  variances  from  targets  where 
major  effort  should  be  concentrated  or  redirected.  To  provide  an  overview  of  the  conver¬ 
gence  progress  for  each  measure,  summary  charts  can  be  used.  An  example  of  such  a  chart 
is  a  parameter  convergence  profile  (planned  value  profile)  chart  as  shown  in  Figure  5-2, 

Estimates  of  current  and  planned  values  are  to  be  based  on  analytical,  test,  and 
evaluation  data,  including: 

•  Credible  engineering  analyses 

6  Simulation  studies 

•  Category  I  and  n  tests,  FACIs,  and  system/CEI  acceptance  tests 

•  Historical  projections,  including  learning  rate 
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Demonstrated  values  are  to  reflect  the  results  from  Integrated  performance  tests  in 
the  actual  environment.  Test  results  that  are  to  be  used  to  determine  demonstrated 
performance  include  those  from  Category  I,  II,  III,  and  TAD  system  tests  which  are 
normally  planned  as  a  part  of  the  overall  Acquisition  and  Operational  programs. 

Information  Flow 

The  effectiveness  monitoring  and  demonstration  status  report  will  orovlde  the  SPO 
and  contractor  management  with  summary-  level  effectiveness  data  that  will  be  use¬ 
ful  for  the  following  purposes: 

■  Guide  technical  evaluations  of  program  progress 

•  Guide  program  redirection 

Highlight  problem  areas  as  they  occur  for  corrective  action 

•  Document  design  solution  history  and  effectiveness  growth 

•  Validate  engineering  design  changes  and  modifications 

•  Guide  deployment  tactics  changes 

Figure  5-3  summarizes  the  information  network  for  the  effectiveness  progress 
monitoring  and  demonstration  activity. 


5-4  FINAL  REPORT  [sTep  E15  1 
General 

A  final  report  is  to  be  submitted  by  the  Acquisition  contractor  to  the  SPO  for  review 
and  acceptance.  The  submittal  of  the  report  is  to  be  coincident  with  the  delivery  of 
the  last  system  to  the  using  command  or  agency,  signifying  the  end  of  the  Acquisition 
Phase.  The  final  report  is  to  indicate: 

•  The  final  analysis  baseline  used  for  the  effectiveness  evaluations,  including 
the  final  form  of  all  models,  the  explicit  description  of  assumptions  and 
analysis  conditions  that  apply  to  their  use,  ard  levels  of  threats. 
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•  The  final  estimates  of  current,  planned,  and  demonstrated  values  versus 
specification  requirements  or  goals  for  the  system  and  subsystem  FOMs,  the 
effectiveness  parameters,  and  the  critical  system  parameters  composited 
by  the  FOMs, 

•  Recommendations  for  model  and  estimate  improvements  baaed  on  factors 
such  as  model  sensitivity  to  specific  assumptions,  more  precise  represen¬ 
tation  of  the  technical  link-up  of  FOMs  to  system  parameters  and  account¬ 
able  factors,  and  performance  areas  imeompletely  demonstrated. 

e  Identification  of  system  constraints  and  improvement  potentials  for  future 
effectiveness  growth. 

•  Analysis  of  the  operational  implications  of  the  achieved  effectiveness. 
Information  Flow 

The  basic  inputs  for  the  contractor  final  report  is  the  effectiveness  progress  monitor¬ 
ing  and  demonstration  status  report,  augmented  by  specific,  detail  effectiveness 
analysis  reports  and  studies  documented  by  the  contractor  throughout  the  Acquisition 
Phase.  Upon  acceptance,  the  final  report  submitted  by  the  contractor  can  be  merged 
by  the  SPO  into  the  final  system  report  submitted  to  higher  headquarters  describing 
total  system  accomplishments  during  Acquisition. 
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Chapter  6 

SYSTEM  AND  COST  EFFECTIVENESS  TECHNICAL  MANAGEMENT 


Summary 

j 

J  Significant  Air  Force  and  contractor  participating  management  actions  are 

i  necessary  to  insure  the  effective  attainment  of  the  objectives  associated  with  the 

i 

|  implementation  of  the  system  and  cost  effectiveness  management  process.  The 
j  significant  actions  which  are  primarily  the  responsibility  of  Air  Force  manage- 
|  ment  are  (1)  determining  and  specifying  Figures  of  Merit,  (2)  establishing  and 
j  specifying  the  data  needed  to  document  and  to  provide  continuing  visibility  and 
!  confidence  of  overall  system  progress  towards  meeting  technical  goals  and 
requirements,  and  (3)  specifying  required  technical  analyses  for  credible  and 
defensible  effectiveness  evaluations.  Major  actions  which  are  principally  the 
responsibility  of  contractor  management  are  (1)  implementing  the  effectiveness 
process,  (2)  planning  for  data  to  provide  for  their  maximum  utility  in  effective¬ 
ness  evaluations,  and  (3)  organizing  for  management  of  the  effectiveness  effort. 
For  both  sets  of  actions,  fundamental  considerations  and  guidelines  are  delineated. 


6-1  GENERAL 


The  principal  objectives  of  the  system  and  cost  effectiveness  management 
process  are  to  provide  Air  Force  and  contractor  management  with: 

•  A  continuing  visibility  and  quantitative  measure  of  confidence  in  overall 
system  progress  towards  meeting  technical  requirements  and  goals. 

•  A  formalized  rationale  for  better  and  more  timely  program  and  technical 
decisions. 

•  Assurance  that  the  system  as  conceived,  defined,  developed,  produced, 
and  transferred  to  the  using  command  or  agency  possesses  an  optimum 
balance  of  performance  capability  and  cost. 


6-1 


The  effective  attainment  of  the  objectives  is  a  participating  Air  Force  and 
contractor  management  effort  requiring  strong  discipline  and  an  orderly  approach. 
Significant  management  actions  necessary  for  an  efficient  and  effective  Implementa¬ 
tion  of  the  system  and  cost  effectiveness  process  involves: 

Air  Force  Management  Action 

•  The  proper  determination  and  specification  of  Figures  of  Merit  that  will 
provide  an  accurate  and  valid  measure  of  the  expected  system  performance 
response  to  meet  assigned  mission  roles. 

•  The  establishment  and  specification  of  the  type  and  amount  of  data  needed, 
appropriate  to  the  system  type  being  procured, to  support  program 
decisions  and  to  provide  visibility  and  confidence  of  system  and  cost 
effectiveness  achievements  and  progress. 

•  The  specifying  of  the  particular  technical  analyses  required  for  an  accurate 
evaluation  of  system  and  cost  effectiveness  based  upon  identifiable  needs 
for  the  analyses. 

Contractor  Management  Action 

•  The  efficient  implementation  of  the  system  and  cost  effectiveness  manage¬ 
ment  process  with  its  continuum  of  activities. 

•  The  scientific  planning  for  the  acquisition  of  realistically  attainable  and 
valid  data  necessary  for  conducting  effectiveness  analyses. 

•  The  establishment  and  implementation  of  organization,  management,  and 
data  feedback  plans  and  controls  for  the  effectiveness  activities. 

The  system  and  cost  effectiveness  management  implementation  process  has  broad 
applicability  to  most  Air  Force  systems  and  procurement  situations.  For  any 
application,  however,  special  management  attention  must  be  given  to  the  need  for 
selectively  applying  the  technical  elements  and  procedures  of  the  process.  This  is 
to  acknowledge  the  special  program  considerations  concomitant  with  the  specific 
nature  of  a  system  or  project,  such  as  the  type  of  contract,  the  program  complexi¬ 
ties,  and  the  absence  of  formalized  program  phases  with  their  concentration  of  effort. 
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6-2  AIR  FORCE  MANAGEMENT 


Determining  and  Specifying  Figures  of  Merit 

The  proper  determination  and  specification  of  system  Figures  of  Merit  are  described 
in  paragraphs  3-3,  4-2,  and  5-2  of  the  manual.  This  task  is  characterized  by  a 
succinct  translation  of  each  set  of  mission  objectives  into  a  quantitative  measure 
of  overall  system  performance.  A  precise  statement  of  the  specific  mission  demands 
against  which  the  system  is  being  acquired  is  a  fundamental  consideration  in  specify¬ 
ing  Figures  of  Merit  that  are  meaningful,  realistic,  and  accurate.  These  mission 
objectives  must  be  defined  in  terms  of  measurable,  system  performance,  behavior, 
and  characteristics.  A  system  is  normally  a  part  of  an  overall  military  force 
structure.  To  achieve  precision  in  the  definition  of  the  mission  objectives  fo?.  a 
system,  the  system  objectives  must  be  traceable  to  top-level  system  effectiveness 
goals  of  the  force  structure  (or  still  higher  levels  if  overall  Air  Force,  Department 
of  Defense,  or  national  objectives  are  being  addressed).  Branching  from  the  force 
structure  level  is  a  layered  hierarchy  of  mission  requirements  with  specific  system 
effectiveness  goals  assignable  for  each  operational  level  down  to  the  system  level. 
Logically,  this  hierarchy  can  be  considered  as  a  Figure  of  Merit  (effectiveness)  tree 
or  breakdown  structure.  The  focal  point  of  the  Figure  of  Merit  tree  normally  will 
be  the  mission  objectives  assigned  to  the  force  to  be  deployed  in  a  specific  time 
frame  to  interdict,  deter,  or  otherwise  control  a  threat  to  national  security.  A 
Figure  of  Merit  can  be  established  for  each  set  of  significantly  different  mission 
objectives  for  the  force  structure  by  conducting  force-level  studies  addressing  the 
required  system  mix  of  the  force  appropriate  to  the  threat  environments  envisioned. 
These  studies  should  consider  factors  such  as  intelligence  estimates  of  enemy 
offensive  and  defensive  potentials,  and  the  Air  Force  strategies  and  tactics  to  be 
employed  to  counter  the  threat  potentials  based  on  the  technical  possibilities  of 
developing  the  needed  force  composition.  Upon  identification  of  the  required  force 
composition  and  effectiveness,  the  assignable  set  of  specific  mission  objectives 
and  Figures  of  Merit  for  each  of  the  different  systems  in  the  force  can  be  resolved 
from  the  higher  order  force  objectives  and  Figures  of  Merit,  As  an  added  degree 
of  detail  for  apportionment  and  other  analysis,  a  simultaneous  breakdown  of  the 
Figure  of  Merit  parameters  of  availability,  dependability,  and  capability  can  be 
accomplished  along  with  the  cascading  of  the  Figures  of  Merit  from  a  top  force 
structure,  or  any  intervening  level,  down  to  the  system  level.  Figure  6-1 
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Figure  of  Merit  Tree 


illustrates  a  Figure  of  Merit  tree  for  a  hypothetical  continental  Air  Defense  Force 
consisting  principally  of  a  warning  and  dc-tf-  jtion  system  and  two  interceptor  aircraft 
wings.  The  force  is  assigned  to  cover  a  sector  area.  This  area  is  partitioned  into 
two  smaller  areas,  the  outer  sector  area  and  inner  sector  area,  with  each  of  the  two 
areas  further  divided  into  two  zones.  The  Figure  of  Merit  tree  shows  the  downward 
branching  of  the  Figure  of  Merit  for  the  Air  Defense  Force  to  the  interceptor  system 
Figures  of  Merit. 

Establishing  and  Specifying  Data 

Factors  to  be  considered  in  establishing  and  specifying  the  data  required  to  document 
the  program  effectiveness  analyses  and  to  provide  the  continuing  visibility  and 
confidence  of  system  and  cost  effectiveness  achievements  and  progress  include: 

•  1'he  data  output  need  and  form.  The  data  must  be  in  a  form  usable  to 
support  program  decisions. 

•  The  data  output  quality.  A  confidence  must  exist  that  the  data  will  be  valid, 
accurate,  and  defensible  to  support  program  decisions. 

•  The  level  of  data  detail.  The  data  level  should  be  limited  to  the  major  CEI 
level,  or  higher  levels  to  which  all  items  of  deliverable  hardware  are 
identified. 

As  a  minimum,  the  following  data  items  should  be  specified: 

•  The  system  and  cost  effectiveness  report  for  Concept  Formulation,  This 
report  is  described  in  paragraph  3-9  of  Chapter  3. 

•  The  system  and  cost  effectiveness  report  for  Definition.  This  report  is 
described  in  paragraph  4-5  of  Chapter  4. 

•  An  effectiveness  progress  status  report  to  coincide  with  the  system  PDR, 
FACI,  CDR,  acceptance  test,  Category  n  test,  and  TAD  milestone  points. 
This  continuing  report  is  described  in  paragraphs  4-4  and  5-3  of  Chapters 
4  and  5,  respectively. 

»  The  final  system  and  cost  effectiveness  report  for  Acquisition.  This  report 
is  described  in  paragraph  5-4  ol  Chapter  5. 


Specifying  Required  Analysis 


The  technical  analyses  required  for  a  credible  evaluation  of  system  and  cost 
effectiveness  performance  are: 

•  Mission  analysis  (paragraphs  3-2,  4-2,  and  5-2) 

•  Figure  of  Merit  definition  analysis  (paragraphs  3-3,  4-2,  and  5-2) 

•  Performance  requirements  analysis  (paragraphs  3-4,  4-2,  and  5-2) 

•  Operational  requirements  analysis  (paragraphs  3-5,  4-2,  and  5-2) 

•  Effectiveness  parameter  selection  analysis  (paragraphs  3-6,  4-2,  and  5-2) 

•  System  and  cost  effectiveness  analysis  (paragraphs  3-7,  4-2,  and  5-2) 

The  characteristics  of  these  analyses  are  described  for  Concept  Formulation, 
Contract  Definition,  and  Acquisition  in  the  above-referenced  paragraphs. 
Additionally,  the  nature  of  the  analysis  results  to  be  documented  and  reported  are 
delineated  in  paragraphs  3-9,  4-5,  5-3,  and  5-4  of  the  manual. 
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6-3  CONTRACTOR  MANAGEMENT 


The  efficient  and  effective  management  implementation  of  the  system  and  cost 
effectiveness  process  by  participating  contractors  will  require  an  authoritative 
perspective  of  the  involved  technical  elements  and  procedures  and  their  mutual 
dependencies  with  those  of  both  the  system  program  management  and  systems 
engineering  management  processes  associated  with  a  particular  system  procure¬ 
ment.  Since  the  procedures  of  the  manual  are  based  on  the  efficient  channeling 
of  engineering  data  and  analyses  to  provide  an  overall  perspective  of  the  system 
technical-cost-time  performance,  the  degree  that  the  activities,  analyses,  and 
data  elements  are  properly  integrated  will  be  a  major  factor  in  the  success  of 
the  system  program  involved. 

Implementing  the  Effectiveness  Process 

The  manual  basically  is  addressed  to  how  the  effectiveness  process  typically  is 
implemented  on  a  time  basis  for  any  class  of  Air  Force  systems.  The  manage¬ 
ment  action  for  this  important  program  consideration  involves  the  judicious 
selection  of  the  major  activities  to  be  timely  implemented  and  to  insure  that  the 
depth  of  implementation  is  consistent  with  the  total  program  scope  and  cost. 

Planning  for  Data 

The  procedures  of  the  manual  are  based  on  the  maximum  use  of  engineering  data 
normally  generated  during  a  typical  system  program,  with  a  minimum  need  for 
additional  data.  Careful  preplanning  and  redirection  of  the  scheduled  analyses, 
studies,  tests,  and  similar  data  sources  will  be  required  to  insure  their  maximum 
usability  for  effectiveness  evaluations.  The  total  data  requirement  for  effectiveness 
evaluations  is  a  composite  of  the  individual  data  needs  described  in  each  step  of  the 
process. 
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Organizing  for  Management  of  the  Effectiveness  Function 


Ii.  Is  vital  that  contractor  overall  management  of  the  effectiveness  function  be 
established  at  an  authoritative  program  level  and  properly  structured.  The  re¬ 
sponsibility  should  be  assigned  to  a  single  organization.  This  does  not  imply 
the  requirement  for  a  new  or  separate  organization  for  system  effectiveness. 
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Chapter  7 

APPLICATION  GUIDELINES  FOR  SPECIFIC  MAJOR 
CLASSES  OF  AIR  FORCE  SYSTEMS 


Summary 

Application  guidelines  are  provided  for  the  aircraft,  ballistic  missile,  booster, 
satellite,  command  and  control,  and  warning  and  detection  classes  of  Air  Force 
systems.  For  each  system  class,  major  technical  elements  of  the  effectiveness 

’■  C 

structure  are  translated  in  terms  of  current  system  performance  and  design 
criteria,  analyses,  and  terminology  to  provide  the  Air  Force  and  contractor 
managers  with  an  authoritative  perspective  of  the  technical  correspondence 
present.  Effectiveness  elements  that  are  translated  include  (1)  mission  objec¬ 
tives,  (2)  mission  conditions,  (3)  Figures  of  Merit,  (4)  effectiveness  parameters, 
(5)  top-level  system  functions,  (6)  system  parameters,  (7)  accountable  factors, 
(8)  transfer  functions,  (9)  cost  effectiveness  measures,  and  (10)  analyses. 


7-1  GENERAL 

This  chapter  provides  application  guidelines  for  major  classes  of  Air  Force 
systems.  Included  are  guidelines  for  the  following  system  classes: 

•  Aircraft  •  Satellite 

•  Ballistic  missile  »  Command  and  control 

•  Booster  •  Warning  and  detection 

Two  prerequisites  are  fundamental  to  the  efficient  implementation  of  the  system 
and  cost  effectiveness  technology.  These  are; 

•  Having  an  overall  perspective  of  the  system  and  coHt  effectiveness 
Implementation  concepts,  technical  elements,  and  management  process 
involvi  d. 
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•  Having  an  intelligence  of  how  the  implementation  concepts,  technical 
elements,  and  management  process  of  the  effectiveness  technology  can 
be  related  specifically  to  the  mosaic  of  current  system  performance  and 
design  criteria,  analyses,  and  terminology  for  a  particular  application. 

Prior  chapters  of  this  manual  were  addressed  to  the  first  of  the  two  implemen¬ 
tation  prerequisites.  The  contents  of  these  chapters  were  directed  at  providing 
Air  Force  and  contractor  program  managers  with  a  broad  perspective  of  the 
general  concepts,  technical  elements,  and  procedures  that  can  be  practically 
and  validly  applied  to  implement  the  effectiveness  technology  during  Concept 
Formulation,  Definition,  and  Acquisition.  Additionally,  an  overview  was 
provided  of  the  interactions  of  the  effectiveness  elements  and  procedures  with 
the  AFSC  system  program  management  procedures  and  systems  engineering 
management  procedures.  This  chapter  is  intended  to  provide  further  insight 
into  the  correspondence  and  required  translations  of  the  effectiveness  technical 
elements  to  the  spectrum  of  current  system  performance  and  design  criteria, 
analyses,  and  terminology.  This  is  the  second  prerequisite  for  implementation 
efficiency.  For  each  class  of  Air  Force  systems,  representative  translations 
are  provided  for  the  following  system  and  cost  effectiveness  technical  elements: 


•  Mission  objectives 

•  Mission  conditions 

•  Figures  of  Merit 

•  Effectiveness  parameters 

•  Top-level  system  functions 


•  System  parameters 

•  Accountable  factors 

•  Transfer  functions  (in  terms  of 
input-output  variables) 

•  Cost  effectiveness  measures 

•  Analyses 


The  representative  translations  are  intended  as  guides  and,  thus,  are  broadly 
lormulated  so  as  to  be  of  general  applicability  to,  and  characteristic  of,  most 
systems  in  the  system  class.  For  any  application,  the  translations  must  be  in 
terms  of  specifically  applicable  and  measurable  system  performance  and  design 
criteria. 


The  specialty  technical  parameters  represent  a  catogory  ol  system  performance 
parameters  that  is  universally  applicable  to  all  major  systoms,  independent  of 
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system  class,  with  only  the  prescribed  parameter  values  and  some  accountable 
factors  being  different  from  one  system  to  another.  Because  of  this  commonality, 
these  parameters  and  their  accountable  factors  are  separately  listed  in  paragraph 
7-2  to  follow.  A  transfer  function  can  be  established  for  each  parameter  listed, 
to  relate  the  output  values  of  the  parameter  to  the  ensemble  of  input  values  for 
its  applicable  set  of  accountable  factors. 


7-2  COMMON  SPECIALTY  TECHNICAL  PARAMETERS 


Parameter 


Accountable  Factor 


•  Mission  reliability 


•  Safety 


•  Survivability 


•  In -operation  maintainability 
and  repairability 


•  Penetrability 


•  Security 


failure  rates 
mission  time 

alternate  modes  of  operation 
override  capabilities 

hazardous  failure  rates 
fail-safe  devices 
human  factors 
special  equipment 

exposure  time 

reaction  time 

dispersal  radius 

hardening  level 

countermeasures 

alternate  modes  of  initiation 

time  constraint 
accessibility 
number  of  spares 
override  capabilities 
adjustment  capabilities 
mean  time  to  repair/replace 
special  skills 

decoys 

hardening  level 
countermeasures 
angle  of  attack 
exposed  surface 

communication  characteristics 
transmission  time  duration 
coding  characteristics 
command  and  control  sequencing 
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Parameter  (Continued) 
•  V  ulnerability 


•  Abort  reliability 

•  Human  performance 

•  Availability 


•  Maintainability 


Accountable  Factor  (Continued) 
armament 

protective  capabilities 
neutralizing  capabilities 
angle  of  attack 
flight  path  profile 
warning  time 

electromagnetic  interference  and 
radiation 

mean  time  to  a  critical  failure 
redundancies 
override  capabilities 
adjustment  capabilities 

frequency  of  tasks 
time  for  tasks 
operation  exposure  time 
accessibility 
special  skills 

basic  maintenance  policy 
level  and  location  of  maintenance 
level  and  location  of  spares 
alert  conditions 

number  of  installations,  sites,  and 
operating  locations 
reaction  time 
warning  time 
operational  schedules 
number  of  systems  in  Wing 
inspection  time 

fraction  of  total  time  in  operation 
installation  and  checkout  time 
checkout  equipment  maintenance  time 
checkout  failure  rates 
inventory  fill  rates 
removal  rates 

organizational,  depot,  and  field  time 
required  for  maintenance 
transportation  time 
time  required  for  mission  interfaces 
with  augmenting  systems 
special  handling  facilities 
number  of  Wing  !evel  personnel  allocated 

mean  and  maximum  time  to  repair 
time  constraints  for  preventive 
maintenance 

typo  and  level  o1  maintenance  personnel 
l»v  sj.  ■<  laltv  .  kills 
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Parameter  (Continued)  Accountable  Factor  (Continued) 

•  Maintainability  (Continued)  mean  and  maximum  time  between 

failures 

mean  and  maximum  preventive 
maintenance  time 
mean  and  maximum  corrective 
maintenance  time 
maintenance  activity  sequencing 
administrative  and  supply  down  time 


7-3  AIRCRAFT 

A.  Mission  Objective 

1.  Transport  System 

The  system  shall  be  capable  of  providing  air  lift  capability  of 
cargo/personnel  at  high  subsonic  speed  within  a  prescribed  time. 

2.  Bomber  System 

The  system  shall  be  capable  of  delivering  a  specified  payload  to 
an  assigned  target  on  time  and  within  prescribed  accuracy  and 
to  return  to  base  point. 

3.  Tactical  System 

The  system  shall  be  capable  of  providing  timely  close  air  support 
for  ground  troops,  providing  air  escort  for  tactical  bombers, 
bombing  tactical  targets,  and  flying  reconnaissance  missions. 

4.  Interceptor  System 

The  system  shall  be  capable  of  destroying  engaged  enemy  aircraft 
at  high  subsonic  speed. 

B.  Mission  Condition  (Other  Than  Natural  Envlx'onment) 

Acoustic  noise 
Altitude  pressure 
Electromagnetic  interference 
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Temperature 

Angular  oscillation 

Sustained  acceleration 

Vibration 

Shock 

Radiation 

Figure  of  Merit  (FOM) 

1.  Transport  System  FOM 

Expected  number  of  ton  miles  to  be  carried  per  unit  of  time. 

Expected  time  required  to  deliver  a  designated  strategic  cargo 
to  a  specified  destination  and  return. 

2.  Bomber  System  FOM 

Probability  of  destroying  (n)  targets  with  (x)  number  of  sorties. 

Probability  of  (n)  bombs  dispersed  within  an  (x)  radius  on  a 
target  of  (y)  hardness  with  (z)  aircraft. 

3.  Tactical  System  FOM: 

Probability  of  providing  timely  troop  support  over  (n)  distance 
with  (x)  number  of  sorties. 

Expected  number  of  sortie  missions  which  can  be  completed  with 
a  fixed  force. 

4.  Interceptor  System  FOM 

Probability  of  destroying  (n)  out  of  (m)  enemy  aircraft  of  a 
specified  type  per  engagement. 

Expected  number  of  aircraft  targets  of  a  given  size  and  type  which 
can  be  neutralized  with  (n)  number  ol  sorties. 
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5.  General  Aircraft  System  FOM 

Expected  number  of  training  missions  which  can  be  completed 
per  month. 

6.  General  Aircraft  Subsystem  FOM 

Probability  of  achieving  a  specified  thrust  with  (n)  engines 
over  (t)  time. 

Probability  that  the  navigation  subsystem  will  perform  to  a 
specified  accuracy  over  (t)  time. 

Expected  accuracy  of  fire  control  subsystem  under  visual  or 
all-weather  conditions. 

Expected  lethality  of  on-board  armament  for  a  specified  target 
posture. 

Expected  number  of  UFH/VFH  communication  channels  operating 
at  a  specified  power  rating  over  (t)  time. 

Probability  of  identifying  a  target  of  type  (x)  and  delivery  of 
payload  to  target  within  (t)  t;me  during  an  (n)  hour  missions. 

Effectiveness  Parameter 

1.  Availability 

The  expected  number  of  aircraft  that  are  in-commision  to  px’oceed 
to  a  tactical  mission  at  any  random  instant  of  time. 

Available  flight  hours  per  month. 

2.  Dependability 

Given  the  availability  state,  the  expected  number  of  aircraft  that 
can  successfully  complete  u  mission  when  commanded. 
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3. 


Capability 

Given  the  availability  and  dependability  states,  the  expected  number 
of  aircraft  systems  that  will  operate  within  specified  system  parameter 
tolerances  in  meeting  their  objectives,  e.  g, ,  within  specified  values 
of  range,  cruise  speed,  rate  of  climb,  etc. 

NOTE:  The  effectiveness  parameters  may  also  be  expressed  in 
terms  of  probability. 

E.  Top-Level  System  Function 

Propulsion 

Flight  control  (manual  and  automatic) 

In-flight  refueling 

In-flight  malfunction  detection 

Cargo  air  drop 

Navigation 

Communication 

Target  destruction 

Takeoff 

Cruising 

Flight  maneuvering 
Terrain  avoidance 
Target  identification 
Payload  delivery 
Instrument  landing 
Visual  landing 
Auxiliary  power  delivery 
Environmental  control 
Loading 

F .  System  Performance  Paramole r 
1.  Functional  Parameter 


Range 

Payload  capacity 
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Rate  of  climb 

Speed  (cruise,  stall,  takeoff,  landing) 

Altitude  (initial  cruise) 

Maneuverability 

lethality 

Takeoff  and  landing  distance 

Center  of  gravity  envelope 

Stability  and  control  characteristics 

Buffet  boundary 

Braking  coefficient 

Cooper  rating 

Auxiliary  power  load 

Cargo  air  drop  tonnage 

Turnaround  time 

Liftoff  weight 

Drag  (takeoff,  cruise,  landing) 

Lift  coefficient  (takeoff  and  landing  maximum) 
One-engine-out  climb  rate 
Weight  (empty,  operating) 

Operating  weight  center  of  gravity 
Thrust  (installed  takeoff,  climb,  cruise) 
Maximum  reverse  thrust 

Stall  pattern  indicator  (cruise,  takeoff,  landing) 

Installed  cruise  thrust  specific  fuel  consumption 

Structural  limit  weight  at  specified  load  factors 

Roll  in  (t)  time 

Air  minimum  control  speed 

Roll  helix  angle 

Lateral  directional  damping 

Longitudinal  short  period  damping 

Temperature  in  flight 

Flotation 

Main  power  load 

Hydraulic  load 
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2.  Specialty  Technical  Parameter 

(See  listing  in  paragraph  7-2  of  this  chapter.) 

G.  Accountable  Factor 

1.  Accountable  Factor  for  Functional  Parameter 

Takeoff  thrust 

Static  thrust 

Nacelle  configuration 

Pylon  configuration 

Thrust  reverser  characteristics 

Equilibrium  angle  of  attack 

Sideslip  angle 

Angle  of  bank 

Air  velocity 

Center  of  gravity 

Monents  and  products  of  inertia 

Aerodynamic  forces 

Gravity 

Applied  moments  about  aircraft  axes 
Aircraft  roll,  pitch,  and  yaw  rates 
Wing  area 

Aileron  configuration 
Spoiler  characteristics 
Trailing  edge  profile 
Angle  of  attack 
Shape  oi  aircraft 
Reynolds  number 
Mach  number 
Heading  Euler  angle 
Horizontal  tail  profile  and  area 
Vertical  tail  profile  and  area 
Elevator  profile 
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Rudder  characteristics 

Velocity 

Target  area 

Landing  field  characteristics 
Search  pattern 
Leading  edge  flaps  -  inboard 
Lift  and  drag  coefficients 
Weight  (takeoff  and  landing) 

Air  density 

Fuel  consumption  rate 
Maximum  frontal  area 
Reaction  time 

NOTE;  Each  of  the  accountable  factors  listed  can  be  broken 
down  to  the  next  lower  level  of  accountable  factors. 
For  example,  the  accountable  factor  of  leading  edge 
flaps  —  inboard  is  influenced  by  area,  location  span, 
maximum  deflection,  percent  of  surface  ahead  of 
hinge  line,  type  of  surface,  rate  of  deflection,  sweep 
angle  of  hinge  line,  equivalent  root  chord  length, 
equivalent  tip  chord  length,  mean  chord  length,  mean 
chord  location,  and  percent  of  wing  affected. 

2.  Accountable  Factor  for  Specialty  Technical  Purr,  mo  tor 
(See  listing  in  puragnxph  7-2  of  this  chapter.) 
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H.  Transfer  Function  (Output  Parameter  as  a  Function  of  Input 
Accountable  Factor) 


Accountable  Factor 


Parameter 
1.  Range 


2.  Takeoff  and  landing 
distance 


3.  Rate  o  'i  climb 


4.  Lift 


5.  Drag 


weight  (final) 
weight  (initial) 
wind 

air  density 
lift  coefficient 
drag  coefficient 
surface  area 
fuel  capacity 
rate  of  fuel  flow 
thrust 

pilot  technique 

ground  condition 

airplane  altitude 

drag  coefficient 

thrust 

speed 

weight 

lift  coefficient 

roll,  pitch,  and  yaw  rates 

sideslip  angles 

lift  coefficient 

dynamic  pressure 

wing  area 

velocity 

thrust 

drag  coefficient 
weight 

angle  of  attack 
surface  area  of  wing 
shape  of  aircraft 
velocity 
air  density 
Reynolds  number 
Mach  number 
lift  coefficient 

drag  coefficient 
maximum  frontal  area 
angle  of  attack 
velocity 
air  density 


7-12 


Parameter  (Continued) 


Accountable  Factor  (Continued) 


6.  Cruise  speed  weight 

dynamic  pressure 
surface  area 
lift  coefficient 
thru  st 

drag  coefficient 


Cost  Effectiveness  Measure 

1.  Transport  System 

Expected  number  ov  consecutive  deliveries  of  specified  cargo  to 
its  destination  within  (x)  hours  per  unit  cost  of  delivery. 

Expected  number  of  ton  miles  of  general  cargo  transported  per 
unit  of  cost. 

Minimum  cost-time  product  required  to  deliver  a  specified  cargo 

2.  Bomber  System 

Expected  number  of  point  targets  destroyed  per  unit  of  cost. 
Expected  number  of  alert  missions  per  unit  of  cost. 

3.  Tactical  System 

Expected  number  of  close  air  supports  per  unit  of  cost. 

Expected  number  of  successful  tactical  bombing  missions  per 
unit  of  cost. 

Expected  number  of  successful  reconnaissance  missions  per 
unit  of  cost. 

Expected  number  of  successful  air  escort,  missions  per  unit 
of  cost. 

4.  Interceptor  System 

Expected  number  of  enemy  aircraft  destroyed  per  unit  of  cost. 


5.  General  Aircraft  System 

Expected  number  of  hours  of  training  accomplished  per 
unit  of  cost.  / 

Expected  cost  of  sustaining  a  specified  force  level  per  year 
for  a  specified  system  effectiveness  value. 

J.  Analysis 

Payload  vs  range 

Takeoff  distance  vs  gross  weight 

Landing  distance  vs  gross  weight 

Altitude  vs  rate  of  climb  for  various  gross  weights 

Airplane  limit  load  factor  vs  Mach  No. 

Drag  rise  vs  Mach  No. 

Power  required  vs  speed 
Velocity  vs  rate  of  roll 

Stick  force  vs  velocity  for  different  tab  angles 

Elevator  floating  angle  vs  angle  of  attack 

Hinge  moment  vs  angle  of  attack 

Elevator  angle  vs  lift  coefficient 

Thrust  required  vs  speed 

Variation  in  lift  and  drag  vs  Mach  No. 

Cruise  speed  vs  range 

Cruise  drag  coefficient  change  vs  range 

Range  vs  operating  weight 

Weight  vs  take-off  distance  over  50  feet 

Air  speed  vs  weight 

Grose  weight  vs  center  of  gravity 

Cargo  load  vs  fuselage  station 

Altitude  vs  equivalent  air  speed 

Landing  distance  vs  weight 

Altitude  vs  range 

Damping  parameter  vs  rolling  parameter 
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7-4  BALLISTIC  MISSILE 


A.  Mission  Objective 

The  system  shall  be  capable  of  delivering  a  payload  to  a  specified  target  within 
a  designated  time,  detonate,  and  do  a  prescribed  amount  of  damage. 

B.  Mission  Condition  (Other  Than  Natural  Environment) 

Acoustic  noise 

Altitude  pressure 

Electromagnetic  interference 

Temperature 

Angular  oscillation 

Sustained  acceleration 

Vibration 

Shock 

Radiation 

Jamming 

Enemy  intercept  threat 

C.  Figure  of  Merit  (FOM) 

1.  System  FOM 

Probability  of  destroying  a  prescribed  target  of  (x)  hardness  in  (t) 
time  with  (n)  targeted  missiles. 

Expected  number  of  targets  destroyed  of  (x)  hardness  with  (n)  or 
less  missiles. 

Expected  level  of  damage  to  an  (x)  hardened  target  with  (n)  or 
less  missiles  in  (t)  time. 

2.  Subsystem  FOM 

Probability  that  the  missile  guidance  system  will  perform  to  a 
specified  in-flight  accuracy  for  a  specified  time. 
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Probability  that  the  payload  will  impact  on  target  for  a  specified 
re-entry  profile. 

Probability  of  achieving  a  specified  thrust  for  each  of  (n)  stages 
over  (t;  time. 

Probability  of  achieving  a  specified  post-boost  maneuver  within 
(t)  time. 

D.  Effectiveness  Parameter 

1.  Availability 

The  expected  number  of  missiles  that  are  ready  to  proceed  to  the 
launch  phase  at  any  random  instant  of  time. 

2.  Dependability 

Given  the  availability  state,  the  expected  number  of  missiles  that 
can  be  launched  successfully  and  delivered  to  the  target  area  when 
commanded . 

3.  C  inability 

Given  the  availability  and  dependability  states,  the  expected  number 
of  missiles  that  will  operate  within  specified  system  parameter 
tolerances  in  meeting  their  objectives,  e.g. ,  within  specified  limits 
of  range,  height  of  burst,  circle  of  equal  probability,  lethality,  etc. 

NOTE:  The  effectiveness  parameters  may  also  be  expressed  in 
terms  of  probability, 

E.  Top-Level  System  Function 

Launch 
Propulsion 
Guidance  and  control 
Staging 

Payload  delivery 
Target  destruction 
Environmental  control 
Maneuvering 
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F.  System  Performance  Parameter 

1.  Functional  Parameter 

Range 

Payload  capacity 
Velocity 
Maneuverability 
Lethality 

Center  of  gravity  envelope 

Stability  and  control  characteristics 

Liftoff  weight 

Drag 

Weight 

Thrust 

Pitch,  yaw,  and  roll 

Temperature  in  flight 

Main  power  load 

Hydraulic  load 

Accuracj 

Altitude 

Trajectory 

Attitude  control  var  iables 

2.  Specialty  Technics  1  Parameter 

(See  listing  in  paragraph  7-2  of  this  chapter.) 

G.  Accountable  Factor 

1.  Accountable  Factor  'or  Functional  Parameter 

Takeoff  thrust 
Static  thrust 
Specific  impulse 
Air  velocity 
Center  of  gravity 
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Moments  and  products  of  inertia 

Aerodynamic  forces 

Gravity 

Roll,  pitch,  and  yaw  rates 
Velocity 
Target  area 
Air  density 

Fuel  consumption  or  burn  rate 

Reaction  time 

Propellant  weight 

Thrust  vector  control  variables 

Thrust  termination  characteristics 

Chamber  pressure 

Burnout  velocity 

Burnout  angle 

Lofting  angles 

Exhaust  velocity 

Impulse-weight  ratio 

Time  on  target 

Vapor  sensing  characteristics 

Pre-flight  pressure  characteristics 

Pre-launch  mass  properties 

Thrust  termination  time 

Timing  errors 

Loop  gain 

Bending  loads 

Angular  velocity 

Gyro  drift  errors 

Mass  properties  tolerances 

Payload  weight 

Drag  loss 

'Arming  and  fuzing  time 
Expen'  3d  inert  weight 

f 

Lethal  radius  i 
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Target  posture  and  dispersal  patterns 

Target  sensing 

Burst  .pattern 

Optional  fuze  set 

Angle  of  attack 

Maximum  frontal  area 

Earth's  radius 

Inertial  platform  alignment 

NOTE:  Each  of  the  accountable  factors  listed  can  be 

broken  down  to  the  next  lower  level  of  accountable 
factors. 


2.  Accountable  Factor  for  Specialty  Technical  Parameter 
(See  listing  in  paragraph  7-2  of  this  chapter.) 


Transfer  Function  (Output  Parameter  as  a  Function  of  Input 
Accountable  Factor) 


Parameter 


Accountable  Factor 


1.  Kange 


2.  Accuracy 


weight 

wind 

air  density 
drag  coefficient 
propellant  capacity 
burn  rate 
engine  balancing 
lofting  characteristics 
apogee  altitude 
velocity  angle 
pitch  program 
thrust 

burnout  velocity 

wind  velocity 
burnout  variables 
earth  rotation 
acceleration 
vehicle  velocity 
lofting 
gyro  drift 
guidance  errors 


3.  Circle  of  equal 
prol>ability  (CEP) 


range  errors 
track  errors 


Parameter  (Continued) 

4.  Thrust 

5.  Specific  impulse 

6.  Total  impulse 

7 .  Overall  rocket  performance 

8.  Time  of  flight 

9.  Lethality 


Accountable  Factor  (Continued) 

thrust  coefficient 
nozzle  throat  area 
chamber  pressure 
characteristic  exhaust  velocity 

exposed  burning  surface 
propellant  linear  burn  rate 
propellant  density 
effective  propellant  weight 

specific  impulse 

hot  gas  weight  flow  rate 

burn  time 

residual  propellant 

thrust  buildup  inefficiencies 

thrust 

specific  impulse 
total  impulse 

pitch  command 

cutoff  velocity 

distance  to  target 

aerodynamic  coefficients 

re-entry  vehicle  ballistic  coefficients 

radius  of  ordnance  effect 
height  of  burst 
ordnance  concentration 
target  profile 


I.  Cost  Effectiveness  Measure 

Minimum  cost  of  destroying  a  prescribed  target  of  (x)  hardness  with 
a  prescribed  probability  of  kill. 

Expected  number  of  targets  of  (x)  hardness  destroyed  per  unit  of  cost. 

Expected  dollar  value,  strategic  value,  or  percent  of  damage  to  enemy 
property  per  unit  of  cost. 

Cost  per  missile  on  target  for  a  specified  probability  of  success. 


J.  Analysis 


Range  vs  theoretical  burnout  velocity 
Mach  number  vs  drag  coefficient 
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Time  vs  roll  moment 

Motor  pressure  vs  vector  angle 

Time  vs  launch  pressure 

Time  .rom  launch  vs  cold  wall  heat  ate 

Mission  time  vs  velocity 

Gross  weight  vs  distance 

Payload  vs  range 

Ve.t'oity  vs  altitude 

Total  impulse  vs  vehicle  gross  weight 

Thrust  vs  velocity 

Gross  weight  vs  center  of  gravity 

Trajectory 


7-5  BOOSTER 

A.  Mission  Objective 

The  system  shall  be  capable  of  directly  injecting  payloads  of  specified  weights  into 
circular  orbit  from  xj  to  nautical  miles  altitude  and  into  any  point  on  the 
conic  of  elliptical  orbits  whose  perigees  and  apogees  are  no  less  than  y^  nautical 
miles  and  no  greater  than  y2  nautical  miles. 

B.  Mission  Condition  (Other  Than  Natural  Environment) 

Acoustic  noise 

Altitude  pressure 

Electromagnetic  interference 

Temperature 

Angular  oscillation 

Sustained  acceleration 

Vibration 

Shock 

Radiation 

Buffeting  and  loads 
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Figure  of  Merit  (FOM) 

1 .  System  FOM 

Probability  of  injecting  a  satellite  vehicle  of  (x)  pounds  into  a 
y-degree  orbit  of  (z)  nautical  mile  altitude  at  (t)  time. 

Expected  number  of  successful  repeat  missions  for  which  the 
booster  can  be  utilized. 

2.  Subsystem  FOM 

Probability  of  achieving  a  specified  thrust  at  any  random  instant 
of  time. 

Effectiveness  Parameter 

1.  Availability 

The  probability  of  the  booster  system  being  ready  to  proceed  to 
the  launch  phase  at  any  random  instant  in  time. 

2.  Dependability 

Given  the  availability  state,  the  probability  of  the  booster  system 
to  inject  a  payload  into  a  specified  orbit. 

3.  Capability 

Given  the  availability  and  dependability  states,  the  probability  of 
the  booster  operating  within  specified  system  parameter  tolerances 
in  meeting  their  objectives,  e.g. ,  within  specified  values  of 
accuracy  and  time. 

Top-Level  System  Function 

Launch 

Propulsion 

Steering  and  stability  control 
Staging 

Orbital  injection 
Thrust  vect  or  control 


F.  SyBtem  Performance  Par°-^eter 

1.  Functional  Parameter 

Ascent  attitude  rates 

Satellite  vehicle  separation  conditions 

Mixture  ratio 

Altitude  thrust 

Altitude  specific  impulse 

Chamber  pressure 

Thrust  buildup  rate 

Injection  accuracy 

Thrust 

Specific  impulse 

Operation  over  mixture  ratio  range 
Operating  cycle 
Engine  start  time 

Chamber  pressure  buildup  time  in  vacuum 
Thrust  unbalance 
Thrust  overshoot 
Differential  shutdown  impulse 
Engine  shutdown 

Chamber  alignment  under  zero  thrust 

Dynamic  characteristics 

Liftoff  weight 

Electrical  power 

Propellant  start  consumption 

Thrust  decay  rate 

Total  shutdown  impulse 

Thrust  vector  control  angular  travel 

Thrust  vector  misalignment 

Gimbaling  limitations 

Autogenous  pressurization 

Nozzle  cant 
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2.  Specialty  Technical  Parameter 

Launch  reaction  time 
Launch  hold  time 
Abort  reaction  time 
Turnaround  time 
Launch  rate 
Launch  window 

(See  additional  listing  in  paragraph  7-2  of  this  chapter.) 
G.  Accountable  Factor 

1.  Accountable  Factor  for  Functional  Parameter 

Takeoff  thrust 

Static  thrust 

Center  of  gravity 

Moments  and  products  of  inertia 

Aerodynamic  forces 

Gravity 

Roll,  pitch,  and  yaw  rates 
Air  density 

Fuel  consumption  or  bum  rate 
Effective  burning  time 
Propellant  weight 

Thrust  vector  control  characteristics 

Thrust  termination 

Chamber  pressure  oscillations 

Burnout  velocity 

Burnout  angle 

Exhaust  velocity 

Impulse-weight  ratio 

Vapor  sensing 

Pre-flight  pressure  characteristics 
Nozzle  expansion  ratio 
Propellant  density 
Cutoff  time 
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Total  time,  liftoff  to  injection  error 

Dynamic  loads 

Angular  velocity 

Thrust  coefficient 

Mass  properties  tolerances 

Payload  weight 

Drag  loss 

Expended  inert  weight 

Angle  of  attack 

Nozzle  throat  area 

Altitude  errors 

Earth  s  radius 

Inertial  platform  alignment 

Hot  gas  weight  flow 

NOTE:  Each  of  the  accountable  factors  listed  can  be  broken 
down  to  the  next  lower  level  of  accountable  factors. 


2.  Accountable  Factor  for  Specialty  Technical  Parameter 
(See  listing  in  paragraph  7-2  of  this  chapter.) 


Transfer  Function  (Output  Parameter  as  a  Function  of  Input 
Accountable  Factor) 


Parameter 

1.  Ascent  attitude  rates 

2.  Injection  accuracy 

3.  Satellite  vehicle  separation 
conditions 

4.  Thrust 


Accountable  Factor 

roll  rate 
pitch  rate 
yaw  rate 

in-track  velocity  error 

flight  path  angle  error 

orbital  inclination  error 

altitude  error 

cross-track  position  error 

total  time,  liftoff  to  injection  error 

pitch  error  relative  to  velocity  error 
yaw  error  relative  to  velocity  error 
roll  error  relative  to  local  vertical 
attitude  rates  about  pitch  or  yaw  axis 
attih  de  rates  about  roll  axis 

thrust  coefficient 
nozzle  throat  area 
chamber  pressure 
characteristic  exhaust  velocity 
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Parameter  (Continued) 


Accountable  Factor  (Continued) 


5.  Specific  impulse  exposed  burning  surface 

propellant  linear  burn  rate 
propellant  density 
effective  propellant  weight 

6.  Total  impulse  specific  impulse 

hot.  gas  weight  flow  rate 
burning  time 
residual  propellant 
thrust  buildup  inefficiencies 

7.  Overall  rocket  performance  thrust 

specific  impulse 
to'al  impulse 


I.  Cost  Effectiveness  Measure 


Expected  cost  per  pound  of  initial  payload  weight  placed  into  orbit. 


J.  Analysis 

Wind  speed  vs  altitude 
Velocity  vs  altitude 
Frequency  vs  gain 
Motor  pressure  vs  vector  angle 
Time  vs  launch  pressure 
Mission  time  vs  velocity 

Total  impulse  vs  vehicle  gross  weight,  altitude,  velocity 
.  Thrust  vs  velocity 
Velocity  vs  burnout  angle 
Burnout  altitude  vs  burnout  angle 


7-6  SATELLITE 


A.  Mission  Qbje  ctive 


The  system  shall  be  capable  of  transmitting  information  at  a  specified  rate  and 
perform  priority  selection  and  schedule  transmissions  in  accordance  with  priority 
rankings. 
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Mission  Condition  (Other  Than  Natural  Environment) 


Acoustic  field 
Pressure/ altitude 
Vibration 
Shock 

Sustained  radiation 
Temperature 

Electromagnetic  inter  Terence 
Sustained  acceleration 
Angular  oscillations 


Figure  of  Merit  (FOM) 

1.  System  FOM 

Probability  of  receiving  and  transmitting  high  priority  information 
within  (x)  seconds  at  prescribed  frequency  ranges. 

Expected  number  of  low  priority  messages  received  and  transmitted 
per  month  within  prescribed  frequency  ranges. 

2.  Subsystem  FOM 

Expected  number  of  SHF  and  VHF  channels  operating  at  a  specified 
effective  radiated  power  for  (n)  years. 

Probability  that  the  satellite  control  subsystem  will  perform  to  a 
specified  accuracy  over  (t)  time. 

Probability  that  the  electrical  power  subsystem  will  provide  (x)  watts 
to  the  communication  and  telemetry  subsystems  for  a  minimum  of 
(n)  years. 

Effectiveness  Parameter 
1.  Availability 

The  probability  that  the  satellite  is  ready  to  proceed  to  the  launch 
phase  at  any  random  instant  of  time. 


2,  Dependability 

Given  the  availability  state,  the  probability  that  the  satellite  will 
transmit  messages  upon  command, 

3.  Capability 

Given  the  availability  and  dependability  states,  the  probability 
that  the  satellite  will  operate  within  specific  s;  p. iem  parameter 
tolerances  in  meeting  their  objectives. 

Top-Level  System  Function 
Dispense  payload 

Achieve  operating  altitude  and  station 
Sustain  orbital  position  and  attitude 
Provide  electrical  power 
Receive  and  transmit  reformation 
Generate  and  transmit  beacon  signals 
Thermal  control 

System  Performance  Parameter 

1.  Functional  Parameter 

Antenra  beam  pointing 
Stabilization  (spin  or  3  axis) 

Power  characteristics 
Separation 

Attitude  control  and  reference 
Satellite  injection 
Solar  cells  deployment 
Antenna  deployment. 

Shroud  separation 
Apogee  motor  separation 
Thrust  (apogee  motor) 

Horizon  sensing 
Coarse  thrust  control 


/ 


Fine  damping 
IF  filtering 
Payload  capacity 
RF  signals 

Effective  radiated  power 

Frequency  characteristics 

Amplitude  response 

Phase  response 

Signal  suppression 

Beacon  characteristics 

Telemetering 

Center  of  gra'irity  envelope 

Steady  state  specific  Impulse 

De-spin 

Signal  conditioning 

2.  Specialty  Technical  Parameter 

(See  listing  in  paragraph  7  -2  of  this  chapter. ) 

G.  Accountable  Factor 

1.  Accountable  Factor  for  Functional  Parameter 

Specific  impulse  (apogee  motor) 

Average  thrust  (apogee  motor) 

Shroud  separation 

Separation  of  launch  vehicle  adapter 

Polarization 

Beacon  signal  level 

Antenna  coverage 

Spin  rate 

Beacon  frequency 

Propellant  containment  characteristics 
Channel  capacity 
Battery  charging 
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Power  distribution 

Power  discharge  and  duty  cycle 

Impedance 

Operating  range 

Intermittent  load  requ  irements 

Power  shunting 

Frequency  range 

Tone  modulation 

Frequency  modulation 

Frequency  accuracy 

Frequency  stability 

Single  signal  level 

Amplitude  response 

Phase  response 

Tone  frequency  spacing 

Beacon  incidental  phase  modulation 

Beacon  interference 

mi. - ...>  1 

1  1IC1  UUV1  liutoc  Itv* 

Spurious  signals 
Pulse  interference 
Output  radiation 
Bit  coding 
Bit  rate 
Word  rate 
Frame  rate 

Frame  synchronous  word 
Data  word 

Satellite  identification  word 
yC  voltage  and  current  channels 
RF  power  channels 
Temperature  channels 
Telemetry  calibration  reference 


Telemetry  bus  voltage 
Sensing  voltage  (dummy  load) 

Decoding  (despin  and  spin) 

Range  filtering 
Input  filtering 
RF  switching 

Tunnel  diode  amplification 
Local  oscillation 
UHF  isolation 
Output  isolation 
Variable  attenuation 
Interstage  filtering 
Input  multiplexing 

NOTE:  Each  of  the  accountable  factors  listed  can  be 

broken  down  to  the  next  lower  level  of  accountable 
factors. 


2.  Accountable  Factor  for  Specialty  Technical  Parameter 
(See  listing  in  paragraph  7-2  of  this  chapter.) 


H.  Transfer  Function  (Output  Parameter  as  a  Function  of  Input 
Accountable  Factor)  _  __ 


Parameter 


Accountable  Factor 


1.  RF  signal 


2.  Effective  radiated  power 


3.  Frequency  characteristics 


signal  level 

capacity 

polarization 

single  signal 
beacon  signal 
antenna  coverage 

frequency  range 
beacon  frequency 

center  frequency  of  transient  passband 
stability  (long  term) 
stability  (short  term) 
stability  (temperature) 
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Parameter  (Continued) 

4.  Overall  amplitude  response 

5.  Satellite  identification 
frequency 

6.  RF  output  characteristics 

7.  Telemetry  accuracy 

8 .  Orbital  stability 


Accountable  Factor  (Continued) 

frequency  variation 
power  output  variation 
receiver  input  signals 
amplitude  variation 
degradation  from  thermal  noise 

spacing  between  tone  frequency 
frequency  stability  (one  year) 
frequency  stability  (one  second) 
frequency  stability  (temperature) 
initial  frequency  accuracy 

effective  radiated  power 
frequency  range 
frequency  stability 
frequency  accuracy 
polarization 

DC  voltage  and  current  channels 
RF  power  channels 
temperature  channels 
telemetry  calibration  reference 

latitude 

longitude 

altitude 

velocity 


I.  Cost  Effectiveness  Measure 

I 

Expected  number  of  consecutive  successful  attempts  to  transmit  a 
high  priority  message  within  (x)  seconds  per  unit  of  cost. 

Expected  number  of  bits  of  low  priority  messages  transmitted  per 
unit  of  cost. 

Expected  number  of  channel-years  per  unit  of  cost  at  a  minimum 
specified  effective  radiated  power. 

J.  Analysis 

Fixed  vs  oriented  solar  arrays 

Spray  coating  vs  cover  slip  of  solar  arrays 

Surface  tension  screens  vs  metallic,  elastomer  diaphragm 

Shunt  vs  series  switching 
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Magnesium  vs  magnesium-thorium  structure 
Body  spin  vs  wheel  launch  vehicle 
Stabilization  wheel  size  vs  angular  momentum 
Stabilization  wheel  size  vs  Bolar  pressure  compensation 
Select  vs  fine  fixed  thruster  arrangements 
Synchronojs  elliptical  apogee  vs  low  circular  altitude 


7-7  COMMAND  AND  CONTROL 

A.  Mission  Objective 

The  system  shall  be  capable  of  locating  an  orbiting  vehicle,  provide  remote 
operation  and  control  of  the  vehicle  and  payload  subsystems,  and  provide 
communication  to  and  from  the  orbiting  vehicle. 

B.  Mission  Condition  (Other  Than  Natural  Environment) 

Temperature 

Electromagnetic  interference 

Jamming 

Radiation 

Shock 

Vibration 

C.  Figure  of  Merit  (FOM) 

1.  System  FOM 

Probability  vhat  the  system  will  operate  continuously  for  (t)  time  and 
locate  an  orbiting  satellite  at  a  given  point  in  time,  transmit  commands 
to  and  receive  data  from  the  satellite,  spatially  correlate  the  data 
when  required,  and  control  and  operate  the  satellite  and  payload 
when  required. 

2.  Subsystem  FOM 

Probability  that  (n)  remote  tracking  stations  will  locate,  track,  receive 
and  transmit  at  any  random  point  in  time. 


\ 

\ 

\ 
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D.  Effectiveness  Parameter 

1.  Availability 

Probability  of  the  command  and  control  system  beit^  ready  to  proceed 
to  the  operational  mode  at  apy  random  instant  of  time. 

2.  Dependability 

Given  the  availability  state,  the  probability  that  the  command  and 
control  system  will  operate  to  provide  support  to  (n)  satellite  systems 
for  a  period  of  (t)  time, 

3.  Capability 

Given  the  availability  and  dependability  states ,  the  probability  that  the 
command  and  control  system  will  operate  within  specified  system 
parameter  tolerances  to  accomplish  each  of  the  following  when 
required: 

•  control  traffic  up  to  (n)  satellites 

•  receive  (y)  quantity  of  data  in  a  prescribed  frequency  range 
from  (n)  satellites  within  (t)  time 

•  process  (y)  quantity  of  data  from  (n)  satellites  within  (t)  time 

•  transmit  (x)  command  decisions  to  (n)  satellites  within  (t)  time. 

E.  r.  jp -Level  System  Function 

Orbit  determination  and  prediction 
Acquisition  and  tracking  of  orbiting  vehicle 
Command  and  control  of  satellite 
Data  processing 
Malfunction  detection 

F.  System  Performance  Parameter 

1.  Functional  Parameter 

Range 

Accuracy 

Tracking 
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Recovery  force  control 
Communications  control 
Mode  generation 
Orbit  determination 
Command  generation 

Command  selection,  monitor,  control,  execution 

Data  base  generation 

Telemetry/tracking  data  processing 

Remote  tracking 

Commanding  transmission 

Commanding  verification 

Telemetry  playback 

Tracking  history  playback 

Telemetry  data  compression 

Piet  ire  definition 

Synchronizing 

Command  prediction 

Mode  and  picture  generation 

Storage  capacity 

Real  time  display  modification 

System  initialization  and  recovery 

On-line  load  monitoring 

Bulk  storage  loading 

Data  base  control 

Data  base  display 

2.  Specialty  Technical  Parameter 

(See  listing  in  paragraph  7-2  of  this  chapter.  ) 

G.  Accountable  Factor 

1.  Accountable  Factor  for  Functional  Parameter 

Raw  tracking  data 
■  Tracking  data  recording  rates 
Pointing  data 
Range  rate 
Ranging  data 
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Radiated  electromagnetic  signals 

Data  compression 

Data  routing 

Search  patterns 

Data  lines 

Orbit  data 

Number  of  channel  paths 

Command  rate,  loading,  storage,  formating,  mode,  and  sequence 

Real  time  control  messages 

Telemetry  signals 

Antenna  information  comparisons 

Data  sorting  and  synchronization 

Transmitting  rate 

Verification  rate 

Data  processing  rate 

information  rate 

Antenna  position 

Signal  maximum  rise  time 

Signal  maximum  fall  time 

Computer  controlling  capabilities 

Computer  interface  equipment  capabilities 

Signal  characteristics  . 

External  load  impedance 
Source  impedance 
Frame  length 

Slave  bus  directing  capacity 

Estimated  time  to  acquisition 

Eotimated  time  to  track 

Antenna  position  range 

Number  of  commands  to  be  transmitted 

Display  capacity 

Processing  mode  capacity 

Monitoring  capacity 

Signal  strength 

Voice  transmission  data  characteristics 
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\ 


Input  ready  signals 
Output  resume  signals 
Signal  duration 
Response  time 

NOTE:  Each  of  the  accountable  factors  listed  can  be  broken 
down  to  the  next  lower  level  of  accountable  factors. 

2.  Accountable  Factor  for  Specialty  Technical  Parameter 
(See  listing  in  paragraph  7-2  of  this  chapter.) 


H.  Transfer  Function  (Output  Parameter  as  a  Function  of  Input  Accountable 
Factor) 


Parameter 


1.  Tracking 


2,  Commanding 


3.  Telemetering 


4.  Data  processing  (telemetry) 


Accountable  Factor 

slave  bus  directing  capacity 
estimated  time  to  acquisition 
estimated  time  to  track 
antenna  position 
range 

data  processing  rates  (real  time) 
antenna  information  comparisons 
antenna  position  range  and  range  rate 

number,  sequence,  and  timing  of 
commands  to  be  transmitted 
number  of  correct  verifications 
echo  signals  (results  and  alarms) 
transmission  mode  for  specific  commands 

display  capacity 
processing  mode  capacity 
monitoring  capacity 
signal  strength  and  quality 
telemetry  processing  modes  (prepass 
or  real  time) 

telemetry  mode  processing  variables 
voice  transmission  data  characteristics 
telemetry  data  range 

number  of  data  signal  inputs 
input  ready  signals 
output  resume  signals 
logic  signal  characteristics 
signal  maximum  rise  time 
signal  maximum  fall  time 
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Parameter  ( Continued) 


Accountable  Factor  (Continued) 


4.  Data  processing  (telemetry) 
(Continued) 


input  Impedance 
voltage 

number  of  data  outputs 

input  request  signals 

information  ready  signals 

function  ready  signals 

normal  channel  signal  characteristics 

buffer  channel  signal  characteristics 

external  load  impedance 


I.  Cost  Effectiveness  Measure 


Expected  number  of  stored  bits  of  information  which  can  be  retrieved 
within  a  specified  time  per  unit  of  cost. 

Expected  number  of  satellites  which  can  be  supported  for  a  prescribed 
period  of  time  per  unit  of  cost, 

Cost  per  hour  of  real  time  operation. 


J.  Analysis 

Geographic  vs  geocentric  latitude 

Probability  of  a  -piisition  vs  integrated  signal -to -noise  ratio 
Probability  of  acquisition  vs  range 
Signal -to -noise  ratio  vs  range 
Attenuation  vs  wavelength 

Background  temperature  from  atmosphere  vs  cosmic  noise 
Rehearsals 


7-8  WARNING  AND  DETECTION 

A.  Mission  Objective 

The  system  shall  be  capable  of  detecting,  warning,  and  tracking  aircraft 
and  missiles  within  a  prescribed  range,  accuracy,  and  time  delay. 

B.  Mission  Condition  (Other  Than  Natural  Environment) 


Acoustic  noise 
Radiated  noise 
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Jamming 

Electromagnetic  interference 

Temperature 

Vibration 

Shock 

C.  Figure  of  Merit  (FQM) 

1.  System  FOM 

Probability  of  detecting  an  object  given  that  (n)  tracks  are  in  process. 

Probability  of  successfully  completing  a  track,  given  detection. 

Expected  number  of  tracks  which  can  be  performed  simultaneously 
within  a  prescribed  accuracy. 

Probability  of  acquiring  a  given  target  within  (t)tima  or  within  (x) 
number  df  scans. 

2.  Subsystem  FOM  ’ 

Probability  of  the  antenua,  efficiency  factor  being  within  x1  to  x2  percent. 

D,  Effectiveness  Pa  ramoter 

1.  Availability 

The  probability  that  the  system  is  in  a  ready  state  at  any  random 
point  in  time  for  continuous  operation. 

2 .  Dependability 

Given  the  availability  state,  the  probability  that  the  system  will 
operate  properly  at  any  random  instant  of  time. 

3.  Capability 

Given  the  availability  and  dependability  states,  the  probability  that 
the  system  will  accurately  detect,  warn,  and  track  an  airborne 
object  at  minimum  range  (x)  to  maximum  range  (y). 
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Top-Level  System  Function 

Transmitting 
Receiving 
Scanning 

Detecting  and  tracking 
Ranging 

Target  identification 
Data  processing 

Control  center  data  communications  network 

System  Performance  Parameter 

1.  Functional  Parameter 

Angle  of  sector  coverage  (horizontal  and  vertical) 
Beam  steering 
Beam  switching 
Range  radius 

Azimuth  angular  accuracy 

Operating  frequencies 

Maximum  radar  range 

Target  acquisition  accuracy 

Tracking  accuracy 

Communications  (alert)  control 

Signal -to -noise  ratio 

Strobe  and  display  scale 

Data  base  display 

Data  base  control 

Height  identification 

Tracking  stability 

Track  count 

Number  of  radar  inputs 

Number  of  simultaneous  intercepts 

Time  delays 

Weapon  target  separation 
Digital  data  link 
Message  processor 
Controller  comparator 
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2.  Specialty  technical  Parameter 

(See  listing  in  paragraph  7-2  of  this  chapter. ) 

Accountable  Factor. 

1.  Accountable  Factor  for  Functional  Parameter 

Maximum  range 
Minimum  range 
Peak  'rower  output 
Pulse  repetition  rate 
Pulse  duration 

Minimum  detectable  received  signal  level 
Antenna  gain 

Antenna  azimuthal/elevation  beamwidth 
Antenna  azimuthal/ elevation  scan  rates 
Receiver  gain 

Receiver  channel  bandwidth 
Receiver  sensitivity 
Unambiguous  range 
Voltage  level 
Receiver  recovery  time 
Azimuth  bearing 
Range  rate 
Doppler  resolution 
Peak  power 

Average  power  and  maximum  average  power 

Frequency  range 

Input  signal  range 

Voltage  threshold 

Dynamic  rango 

Input  impedance 

Output  signal  discernability  range 
Selection  range  of  open  channels 
Pulse  shape 
Power  output  variation 
Leakage  resistance 
Waveshapes 
Electrical  continuity 
Pulse  length 


Voltage  standing  wave  ratio 
Side  lobe  and  back  lobe  levels 
Beam  switching  time 
Frequency  response 
Signal  integration  time 
Signal  processor  gain 
Transmitter  power  output 
Blip/  scan  ratio 
Harmonic  distortion 
Intermodulation 

Linearity  (converter,  multiplexer,  analog) 

Spurious  signal  level 
Transmitter  pulse  width 
Signal  amplitude 
Pulse  rate  per  second 
Thermal  noise 

Antenna  rotation  characteristics 
Scan  speed 

Target  area,  speed,  heading,  position,  count 
Target  distance 
Antenna  reflected  area 
Received  power 
Transmitted  peak  power 
Effective  aperture  area 
.  Transmitter  frequency 

NOTE:  Each  of  the  accountable  factors  listed  can  be  broken 
down  to  the  next  lower  level  of  accountable  factors. 

2.  Accountable  Factor  for  Specialty  Technical  Parameter 

(See  listing  in  paragraph  7-2  of  this  chapter.) 

H.  Transfer  Function  (Output  Parameter  as  a  Function  of  Input 
Accountable  Factor) 

Parameter  Accountable  Factor 

1.  Target  acquisition  accuracy  range 

azimuth  bearing 
range  ratio 
acceleration 
target  course  and  count 
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Accountable  Factor  (Continued) 


Parameter  (Continued) 

2.  Tracking  accuracy  (radar) 


3.  Signal -to-noise  ratio 

4.  Scattering 

5.  Detection 

6.  Maximum  radar  range 


doppler  resolution 

azimuth  angular  accuracy 

frequency 

peak  power 

average  power 

pulse  length 

pulse  repetition  rate 

antenna  gain 

signal  integration 

time 

signal  processor  gain 

beacon  antenna  gain 
signal  loss 
transmitter  powar 
target  range 
radar  wavelength 

radar  wavelength 
radius  of  object 

threshold  voltage 
amplitude  of  signal  or  noise 

noise  factor 
signal-to-noise  ratio 
equivalent  noise  bandwidth 
temperature  of  signal  source 
system  loss  factor 
power  gain 
radar  wavelength 
transmitter  power 
target  cross  section 


I.  Cost  Effectiveness  Measure 

Minimum  cost  of  detecting  and  tracking  an  object  for  a  specified 
probability. 

Expected  number  of  track-hours  with  a  specified  accuracy  of  track 
per  unit  of  cost. 

J.  Analysis 


Altitude  vs  range 

Filter  matching  losses  for  peak  vs  average  signal 
Loss  (db)  vs  number  of  range  elements  observed 
Loss  (db)  vs  noise  deflection 
Attenuation  vs  frequency 
Velocity  vs  range 
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Amplitude  vs  range 

Normalized  thermal  noise  error  vs  slgnal-to-noise  ratio 

Target  location  vs  position  error,  velocity  error 

Tracker  elevation  angle  error  vs  range 

Multipath  error  relationships 

Scanning  loss  vs  scan  speed 

Live  interceptions 

Simulated  interceptions 
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Appendix  A 

EXAMPLE  OF  IMPLEMENTATION  PROCEDURES 

1.  INTRODUCTION 

An  example  is  presented  herein  to  illustrate  and  demonstrate  the  implementation 
guidelines  and  procedures  described  in  the  manual  for  the  formulation  of  criteria  an  ’ 
evaluation  of  system  and  cost  effectiveness  during  the  Concept  Formulation  Phase. 

This  example  follows  the  step-by-stpp  sequence  of  effectiveness  activities  detailed  for 
this  phase  in  Chapter  3,  and  addresses  the  analysis  of  a  hypothetical  transport  aircraft 
concept.  In  actual  practice,  the  analysis  results  would  be  compared  with  those  of  com¬ 
peting  system  concepts  to  arrive  at  a  selection  decision  of  the  preferred  system(s)  to  be 
defined  in  the  Definition  Phase.  This  selection  decision  is  based  upon  many  program 
management  factors  additional  to  a  system's  potential  performance  and  cost  stance. 

Since  these  factors  are  beyond  the  scope  of  this  manual,  the  selection  decision  process 
is  not  illustrated  herein. 

A  restrictive  coverage  is  provided  for  the  effectiveness  criteria  formulation  and  evalua¬ 
tion  elements  of  (1)  mission  analysis,  (2)  performance  requirements  analysis,  (3)  opera¬ 
tional  requirements  analysis,  (4)  effectiveness  parameter  selection,  (5)  model  structur¬ 
ing,  and  (6)  system  and  cost  effectiveness  analysis.  This  is  to  simplify  the  example  for 
ease  of  understanding  since  a  full  illustration  of  the  effectiveness  process  would  be  com¬ 
plex  for  a  transport  aircraft  system.  Furthermore,  a  more  complete  analysis  would 
entail  basically  an  extension  of  the  procedures  illustrated  in  the  example  to  accommodate 
a  broader  spectrum  of  critical  top-level  system  parameters  and  accountable  factors 
without  materially  altering  their  content. 
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2.  MISSION  ANALYSIS 


The  transport  aircraft  system  is  to  be  designed  to  fulfill  a  mission  of  providing  long- 
range  airlift  capability  at  high  subsonic  speed  over  any  type  of  route.  The  system  also 
is  to  have  an  all-weather  operational  capability.  Variations  of  this  general  mission 
are  considered  as  different  specific  missions.  These  include: 

(1)  The  basic  long  range  mission. 

(2)  The  maximum  payload  mission  with  a  specified  g  factor. 

(3)  The  basic  payload  mission  with  a  specified  g  factor. 

(ft)  The  re-supply  mission. 

The  specific  missions  are  to  be  accomplished  with  a  minimum  of  elapsed  time  and  costs. 
The  technical  and  cost  performance  potentials  of  the  system  for  missions  (1)  and  (2)  only 
will  be  numerically  analyzed  since  the  techniques  for  determining  system  and  cost  effec¬ 
tiveness  for  these  two  missions  typically  can  be  applied  to  missions  (3)  and  (4). 

All  missions  are  tc  be  achieved  in  the  presence  of  hostile  enemy  threats  and  diverse 
climatic  conditions  expected  to  be  encountered  at  any  land  area  where  the  Air  Force  will 
have  a  mission  to  move  a  large  and  varied  quantity  of  personnel  or  cargo.  For  the  pur¬ 
pose  of  the  example,  the  assumed  threat  levels,  threat  intensities,  probability  of  each 
threat  occurring,  and  the  average  threat  intensities  postulated  to  influence  system  per¬ 
formance,  and  hence  mission  outcome,  are  listed  in  Table  A-l.  The  average  threat 
intensities  currently  expected  will  be  used  in  the  effectiveness  analysis.  Additionally, 
the  example  considers  only  the  effect  of  headwinds  and  atmospheric  density  from  the 
following  atmospheric  conditions  typically  influencing  system  performance: 

(1)  Headwind 

(2)  Atmospheric  density 

(3)  Tailwind 

(4)  Crosswind 

(5)  Temperature 

(6)  Acceleration  of  gravity 

(7)  Atmospheric  pressure 
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TABLE  A-l  ASSUMED  THREAT  LEVEI£ 


Antiaircraft 

Nominal 

Current 

5  Years  in  Future 

Threat 

Level 

Intensity 

Probability 

Average^ 

Intensity 

Probability 

Average^ 

Intensity 

Light 
(Including 
no  threat) 

6.06xl0-9 
lethal  rounds 
per  square 
foot  per  hour 

0.66 

4. OxlO-9  =  L 

0.62 

i 

3.  7<»xl<f  9 

1 

i 

Moderate 

lOOxlO-9 
lethal  rounds 
per  second  if 
no  protection 

0.18 

18x10'9  =  L2 

0.18 

-f) 

18x10 

1 

Heavy 

1.0  milli- 
roentgen, 
per  hour'  ' 

0.16 

0. 16  =  L 

0 

0.20 

0.20 

(1)  Average  intensity  ia  obtained  by  nr’’  flying  the  nominal  intensity  of  the  threat  level 
by  the  probability  of  the  threat  .1  occurring. 


(2)  Associated  with  the  effect  of  a  milliroentgen  per  hour  exposure  is  a  probability 
(Raq)  that  the  aircraft  will  be  disabled  during  any  time  it  is  unprotected. 


3.  SPECIFYING  PRELIMINARY  FIGURES  OF  MERIT  (FOMs) 


On  the  basis  of  the  mission  analysis,  preliminary  FOM  measures  are  defined  for  use 
in  evaluating  the  performance  effectiveness  of  the  system  to  meet  the  mission  objectives. 
These  measures,  which  characteristically  are  grossly  definable  during  Concept  Formu¬ 
lation,  are: 

(1)  The  probability  of  achieving  a  basic  long  range  mission  with  a  specified 
payload.  This  is  to  be  at  least  0. 98  as  a  goal  for  a  peacetime  mission  and 
0. 70  for  a  wartime  mission. 

(2)  The  average  number  of  ton-nautical  m:lles  of  cargo  delivered  per  aircraft 
per  day  over  the  lifetime  of  all  aircraft  in  the  fleet.  This  is  to  be  at  least 
340,000  ton-miles  as  a  goal. 

(3)  The  probability  of  achieving  a  maximum  payload  mission.  This  is  to  be  at 
least  0.97  as  a  goal. 

(4)  The  average  number  of  personnel- miles  delivered  per  aircraft  per  day  over 
the  lifetime  of  all  aircraft  in  the  fleet.  This  is  to  be  2,000,000  personnel- 
miles  as  a  goal. 

The  system  and  cost  effectiveness  analysis  illustrated  in  this  example  is  restricted  to 
the  evaluation  of  FOMs  (1)  and  (2). 

4.  PERFORMANCE  REQUIREMENTS  ANALYSIS 

All  FOMs  defined  are  relatable  to  critical  system  functions  that  must  be  present  for  the 
transport  aircraft  to  accomplish  its  assigned  mission.  The  extent  to  which  the  functions 
can  be  achieved  i8  measurable  by  output  parameters  of  the  system.  These  system 
parameters,  in  turn,  depend  on  critical  accountable  factor  inputs.  Table  A-2  is  a  list¬ 
ing  of  typical  system  parameters,  functions,  and  accountable  factors  for  the  hypothetical 
transport  aircraft  system,  categorized  by  the  effectiveness  parameter  sets  of  depend¬ 
ability  and  capability  to  which  they  can  be  related.  The  numerical  example  considers 
the  system  parameters  of  range,  maximum  payload,  cruise  velocity,  safety,  vulnera¬ 
bility,  survivability,  and  reliability.  These  parameters  are  associated  with  the  cruising 
phase  of  an  aircraft's  flight  profile. 
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TABLE  A-2  SYSTEM  PARAMETERS,  FUNCTIONS, 
AND  ACCOUNTABLE  FACTORS 


Parameter 

Function 

Accountable  Factor 

Dependability 

•  Survivability 

Exposure  time 

Reaction  time 

Dispersal  radius 

Hardening  level 

Alternate  modes  of  initiation 

•  Reliability 

Failure  rates 

Mission  time 

Alternate  modes  of  operation 
Override  capabilities 

Capability 

•  Range 

Propulsion 

Cruise  velocity 

Specific  impulse  of  fuel 

Aerodynamic  lifting 

Drag  coefficient 

Wing  surface  area 

Lift  coefficient 

Weight- initial,  final 

In-flight  refueling 

Rate  of  in-flight  refueling 

•  Maximum  Payload 

Aerodyna  mic  lifting 

Cruise  lift  coefficient 

Cruise  drag  coefficient 

Propulsion 

Thrust  available 

Payload  delivery 

Volume  of  compartment 

Load  factor  (g) 

Empty  weight 

•  Cruise  Velocity 

Aerodynamic  lifting 

Weight 

Atmospheric  density 

Wing  surface  area 

Cruise  lift  coefficient 

Drag  coefficient 

Thrust 

•  Safety 

Hazardous  failure  rates 

Fail  safe  device 
characteristics 
Human  factors 
Special  equipment 
characteristics 
Reaction  time 


TABLE  A-2  SYSTEM  PARAMETERS,  FUNCTIONS, 
AND  ACCOUNTABLE  FACTORS  (Continued) 


Parameter  Function  Accountable  Factor 


Capability  (Continued) 

•  Vulnerability  Armament  protective 

capabilities 

Neutralizing  capabilities 
Angle  of  attack 
Flight  path  profile 
Warning  time 


«*  Take-off  and 

Landing  Distance 

Propul, lion 

Thrust 

—  chamber  pressure 

~  area  of  burn  surface 

-  thrust  coefficient 

Speed 

Coefficient  of  rolling  friction 

Aerodynamic  lifting 

Take-off  lift  coefficient 
Take-off  drag  coefficient 

Wing  surface  area 

Weight 

•  Rate  of  Climb 

Aerodynamic  lifting 

Wing  surface  area 

Angle  of  climb 

Eirag  coefficient 

Weight 

Lift  coefficient 

Atmospheric  density 

-  Altitude 

-  Sea  level  pressure 

Propulsion 

Thrust 

•  Accuracy  of 
Navigation 

Navigation 

Accuracy  of  position  and 
velocity  meters 

Accuracy  of  guidance 

•  Cooper  Rating  Flight  stabilization  Horizontal  directional 

stability 

Vertical  directional  stability 
Roll  stability 


5.  OPERATIONAL  REQUIREMENTS  ANALYSIS 


Major  operational  parameters  influencing  availability  include: 

(1)  Average  flight  hours  per  day. 

(2)  Maintenance  man-hours  per  aircraft  flight  hour. 

(3)  Average  crew  size  for  maintenance. 

All  of  these  parameters  are  included  in  the  numerical  effectiveness  analysis. 

/ 

6.  EFFECTIVENESS  PARAMETER  SELECTION  / 

The  next  step  in  the  effectiveness  formulation  prodess  is  to  identify  the  system 
parameters  and  accountable  factors,  and  their  vanies,  critically  influencing  the  selected 
FOMs  and,  thus,  to  be  addressed  in  the  effectiveness  analysis.  The  critical  system 
parameters  and  accountable  factors  to  be  considered  in  the  example  are  listed  in 
Table  A-3.  Sensitivity  relationships  based  on  historical  design  experience  which  are 
useful  to  correlate  the  influence  of  accountable  factors  on  system  parameters  are  listed 
in  Table  A-4.  Some  specific  numerical  relationships  will  be  established  in  the  effective¬ 
ness  analyst!  step  of  the  effectiveness  process  to  be  illustrated  in  paragraph  8.  All 
values  for  system  parameters  and  accountable  factors  listed  in  Table  A-3  and  used 
throughout  the  example  are  hypothetical. 


TABLE  A-3  CRITICAL  SYSTEM  PARAMETERS 
AND  ACCOUNTABLE  FACTORS 


FIGURE  OF  MERIT  (1):  Probability  of  achieving  a 
basic  long  range  mission  with  a  specified  payload. 


Mission  Condition 

Intensity  of  light  threat  (L,) 
Intensity  of  moderate  threat  (L2) 
Intensity  of  heavy  threat  (L^) 
Lethality  per  milliroentgen  (R^p) 
Standard  deviation  of  winds 


Assumed  Accountable 
Factor/Parameter  Value 

-9 

4  x  10  round  per  sq.  ft.  per  hour 

-9 

18  x  10  round  per  second 
0. 16  milliroentgen 

-7 

10  per  milliroentgen 
20  knots 


Availability  (A)  * 

Average  potential  flight  hours  usable  * 

per  day  (F^) 

Maintenance  manhours  per  aircraft  4,  o  manhour /hr. 

flight  hour ,  minimum  (M^) 

Average  crew  size  for  maintenance  (Cr)  10  men 


Dependability  (D)  * 

Reliability,  minimum  0,98 

Reliability,  actual  * 

”6 

Coefficients  relating  weight  to  0.85,  10  ,  10 

reliability  (pr  p2,  p3) 

Coefficients  relating  weight  to  0.02,  0.001 

survivability  (r^  r^) 

Survivability  * 


Capability  (C) 

Expected  operating  lifetime  (T) 

Fuel  consumption  (c') 

Drag  coefficient  due  to  .’kin 
friction  (C^) 

Oswald's  efficiency  factor  (e) 


* 

300,000  hours 
0.32/hr. 

0.03 

1.0 


♦Denotes  a  value  to  be  calculated 
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TABLE  A-2  CRITICAL  SYSTEM  PARAMETERS 
AND  ACCOUNTABLE  FACTORS  (Continued) 


Capability  (C)  (Continued) 

Lift  Coefficient  (C^) 

Payload  (P^) 

Maximum  initial  weight  (WQ) 

Safety 

Surface  area  of  wings  (S) 

Surface  area  of  aircraft  (A^Rg) 
Maximum  cruise  altitude  (A^m) 
Range 

Efficiency  of  protection  against 
light  threat  (l^) 

Efficiency  of  protection  against 
medium  threat  (k2) 

Efficiency  of  protection  against 
heavy  threat  (kg) 

Empty  weight  excluding  weight? 
allocated  to  reliability,  surviva¬ 
bility,  and  protection  against 
threats  (W£) 

Relative  air  density  (a) 

Final  weight  (W^) 

Wing  span  (b) 

Drag  coefficient  (CD) 

Velocity  of  flight  for  maximum 
range  (V) 

Range  in  still  air  (R) 

Weight  allocated  to  reliability  (W^) 

Weight  allocated  to  survivability  (Wg) 

Allocation  of  payload  to  protection 
against  threats  (Wp) 

FOM  (1) 


Assumed  Accountable 
Factor/Parameter  Value 


0.5 

250,000  lb. 

700,000  lb. 

0.999 

5,800  sq.  ft. 

8,700  sq.  ft. 

40,000  ft. 

4,000  nautical  miles 
50.  0  sq.  ft. /lb. 

50.0  sq.  ft. /lb. 

62.5  sq.  ft. /lb. 

300,000  lb. 


0.  245 
* 

* 

* 

* 

* 

* 

* 

* 

* 


♦Denotes  a  value  to  be  calculated 
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TABLE  A-3  CRITICAL  SYSTEM  PARAMETERS 
AND  ACCOUNTABLE  FACTORS  (Continued) 


FIGURE  OF  MERIT  (2):  The  average  number  of  ten  miles  of 
cargo  delivered  per  aircraft  per  day  over  the  lifetime  of  all 
aircraft  in  the  fleet. 


Assumed  Accountable 
Factor/Parameter  Value 

Mission  Condition 

(Same  conditions  as  for  FOM  (1))  (Same  values  as  ior  FOM  (1)) 

Availability  (A) 

(Same  parameters  as  for  FOM  (1))  (Same  values  as  for  FOM  (1)) 


Dependability  (D) 

Reliability,  minimum 
Reliability,  actual 
Survivability 

Coefficients  relating  weight  to 
reliability 

Coefficients  relating  weight  to 
survivability 


(Same  value  as  for  FOM  (1)) 

* 

* 

(Same  values  as  for  FOM  (1)) 

(Same  values  as  for  FOM  (l)) 

i 


Capability  (C) 

Expected  operating  lifetime  (T) 

Surface  area  of  aircraft  (ACKg) 

Surface  area  of  wings  (S) 

Maximum  cruise  altitude  (A^m) 

Fuel  consumption  (c1) 

Final  weight  (Wj) 

Drag  coefficient  due  to  skin 
friction  (CDf) 

Oswald's  efficiency  factor  (e) 

Lift  coefficient  (C^) 

Empty  weight  excluding  weights 
allocated  for  reliability,  surviv¬ 
ability,  and  protection  against 
threats  (Wg) 

♦Denotes  a  value  to  be  calculated 


300,000  hrs. 
8,700  sq.  ft. 
5,800  sq.  ft. 
40,000  ft. 
0.32/hr. 
550,000  lb. 
0.03 

1.0 

0.5 

300,000  lb. 
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,, TABLE  A-3  CRITICAL  SYSTEM  PARAMETERS 
AND  ACCOUNTABLE  FACTORS  (Continued) 


Assumed  Accountable 
Factor /Parameter  Value 

Capability  (C)  (Continued) 


Maximum  initial  weight  (W^) 

700,000  lb. 

Efficiency  of  protection  against 
light  threat  (kj) 

0.  5  sq.  ft,,  /lb. 

Efficiency  of  protection  against 
medium  threat  (k^) 

0.  5  sq.  ft.  /lb. 

Efficiency  of  protection  against 
heavy  threat  (kg) 

0.625  sq.  ft. /lb. 

Safety 

0.999 

Range 

4,000  nautical  miles 

Relative  air  density  (°) 

0.245 

Wing  span  (b) 

* 

Drag  coefficient  (CD) 

* 

Payload  (PT) 

* 

Weight  allocated  for  reliability  (WR) 

* 

Weight  allocated  for  survivability  (Wg) 

* 

Total  Cost  (C  ) 

* 

Average  maintenance  cost  per 
manhour  (C3) 

$10/hr. 

Fuel  and  related  cost  (C^) 

$0. 25/lb. 

Fixed  daily  cost  (C^) 

* 

Maintenance  cost  (C2) 

* 

Fuel  and  related  cost  (Cg) 

* 

FOM  (2) 

* 

Cost  Effectiveness 

* 

♦Denotes  a  value  to  be  calculated 


TABLE  A-4  SENSITIVITY  RELATIONSHIPS 

x  pound  change  in  payload  =  y  ton-nautical  mile  per  day* 
x  unit  of  survivability  =  y  ton-nautical  mile  per  day* 
x  pound  of  protection  =  y  unit  of  vulnerability* 
x  pound  of  protection  =  y  pound  of  payload* 
x  foot  cruising  altitude  =  y  ton-nautical  mile  per  day* 
x  unit  lift  coefficient  =  y  foot  takeoff  distance 
x  pound  payload  =  y  foot  cruising  altitude 

x  unit  fuel  consumption  rate  coefficient  =  y  nautical  mile  range* 
x  foot  cruising  altitude  =  y  nautical  mile  range* 
x  pounds  payload  -  y  nautical  mile  range* 
x  unit  lift  coefficient  =  y  nautical  mile  range* 
x  unit  drag  coefficient  =  y  nautical  mile  range* 
x  pound  of -weight  =  y  reliability* 
x  pound  of  weight  =  y  survivability* 

x  unit  fuel  consumption  rate  coefficient  =  y  cost  per  day* 
x  pound  payload  =  y  cost  per  day* 
x  unit  lift  coefficient  =  y  cost  per  day* 
x  unit  drag  coefficient  due  to  skh.  friction  =  y  cost  per  day* 

*To  be  derived  from  numerical  analysis  of  paragraph  8 
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7.  MODEL  STRUCTURING 


Availability  Parameter 

For  each  of  the  FOMs  to  be  evaluated,  availability  is  measured  as  the  fraction  of 
available  daily  utilization  hours  to  total  daily  hours  over  an  extended  period  of  time  for 
a  typical  aircraft  in  the  fleet.  An  aircraft  is  considered  available  when  it  is  not  out- 
of-commission  due  to  maintenance.  (An  alternate  measure  could  be  based  on  an  air¬ 
craft's  instantaneous  availability,  which  is  the  probability  that  an  aircraft  will  be  ready 
within  a  prescribed  time. )  Availability  (A)  may  be  expressed  as: 

'  =  1  -H<*%bV°r>  (1> 


where 

Mmh  is  the  number  of  maintenance  manhours  per  aircraft  flight  hour 

F  is  the  average  potential  flight  hours  usable  per  day 
1  \ 

Cr  is  the  average  crew  size  for  maintenance 

The  quantity  (M^  F^/C^ )  in  equation  (1)  represents  the  average  number  of  hours  per 
day  required  by  a  crew  of  (Cf)  men  to  perform  all  the  maintenance  on  the  aircraft. 
During  this  time,  the  aircraft  cannot  be  utilized.  This  average  number  of  maintenance 
hours  per  day  includes  both  the  daily  scheduled  maintenance  time ,  as  well  as  other 
maintenance  time  which  may  render  the  aircraft  unavailable  for  extended  periods  of 
time.  The  average  number  of  maintenance  hours  per  day,  divided  by  24,  is  then  the 
average  fraction  of  total  daily  hours  that  a  typical  aircraft  Is  unavailable.  This  is  sub¬ 
tracted  from  1  to  obtain  the  numerical  value  for  availability. 

The  potential  number  of  flight  hours  per  day  (Ft>  that  a  typical  aircraft  can  be  utilized 
is  calculated  by  multiplying  the  availability  measure  by  24,  namely, 

Ft  =  24  A  (2) 
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The  solution  of  equations  (1)  and  (2)  simultaneously  results  in  the  following  relation  for 
availability: 


Dependability  Parameter 

For  each  of  the  FOMs  to  be  evaluated,  dependability  is  considered  as  the  probability 
that  the  aircraft  system  will  continue  to  function  given  that  it  was  available  at  the  begin¬ 
ning  of  the  mission.  For  the  example,  dependability  is  structured  as  the  product  of  the 
system  parameters  of  reliability  and  survivability.  Reliability  for  the  transport  air¬ 
craft  system  is  defined  ar>  the  probability  that  the  aircraft  will  reach  its  destination. 

The  goal  for  reliability  is  0. 98.  Survivability  is  defined  as  the  probability  that  either 
the  aircraft  will  survive  all  ground  threats  or  that  no  ground  threats  exist,  subject  to 
the  condition  that  the  aircraft  is  available.  Survivability  is  defined  as  the  probability  (P) 
that  the  aircraft  and  jrew  will  survive  a  hostile  ground  threat,  given  that  both  are  avail¬ 
able,  It  is  assumed  that  the  aircraft  and  crew  can  survive  a  ground  threat  if  either  (1)  a 
moderate  or  heavy  threat  is  present,  but  the  aircraft  and  crew  can  react  (including  takeoff) 
within  20  minutes,  or  (2)  only  a  light  threat  (including  no  threat)  is  present  for  which  it  is 
assumed  that  in  all  instances  there  is  sufficient  time  to  react  if  necessary.  Therefore, 
system  dependability  can  be  expressed  as: 


Dependability  =  Survivability  x  Reliability  (4) 

with: 

Survivability  =  P  |  Survival}  (5' 

-  P  |  A  light  threat  is  present  } 

+  P  {  A  moderate  or  heavy  threat  is  present  and  reacting  within  20  minutes} 
=  P  {  Light  threat } 

+  P  |  Moderate  or  heavy  threat  }  P  {  Reacting  within  20  minutes  } 

=  P  {  Light  threat } 

+  1 1  -  P  {  Light  threat }  j  P  |  Reacting  within  20  minutes } 
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The  probability  of  reacting  in  20  minutes  is  considered  to  be  a  function  of  whether 
special  features  are  incorporated  in  the  aircraft,  such  as  additional  thrust  in  engines 
to  increase  takeoff  thrust  and/or  decrease  starting  time.  Such  features  are  assumed 
to  add  weight  to  the  aircraft  and  affect  the  capability  of  the  aircraft.  This  probability 
can  be  approximated  by: 

P  { Reacting  in  20  minutes}  =  Pj  +  P2  wg  “  P3wg  (6) 


where 

Pj  is  the  probability  of  reacting  within  20  minutes  without  the 

special  features 

Wg  is  the  weight,  in  pounds,  of  such  special  features 

P2  and  r  ^  are  the  sensitivity  coefficients  relating  probability  of  reacting 
within  20  minutes  to  the  weight  of  the  added  features 

Similarly,  reliability  may  be  represented  by  a  transfer  function  of  the  weight  effec¬ 
tively  allocated  to  redundant  equipment.  This  transfer  function  is  assumed  to  be  of 
the  form: 

Reliability  -  (0.99)  j^l.O  -  ^  exp  |-r2WR|j  (7) 

where 

r1  is  a  parameter  such  that  reliability  with  no  redundancy  is 

0.99  (1  -  Tjh  whereas  reliability  with  maximum  redundancy 
is  0. 99 

r2  is  a  parameter  which  relates  the  rate  of  increase  in  reliability 

to  the  amount  of  redundancy 

WR  is  the  weight,  in  pounds,  which  can  be  effectively  allocated  for 

equipment  redundancies  to  increase  reliability. 
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Therefore,  the  combined  equation  for  dependability  is 


Dependability  = 


P  { Light  threat}  +  jl  -  P  { Light  threat} j 

x  (P1  +  P2WS  "  P3Ws)|  (0-">  I1*0  "  rl  exP  j"r2WR |) 


(8) 


Capability  Parameter  For  FQM  (1) 

The  capability  parameter  for  FOM  (1)  (the  probability  of  achieving  a  basic  long 
range  m'  'sion  for  a  specified  payload  Pj_,)  is  the  conditional  probability  of  achieving 
adesireu  i  ,\g  range,  given  that  the  aircraft  system  is  available  and  dependable. 


The  equation  for  the  range  (R)  in  still  air  of  a  turbojet  aircraft  in  nautical  miles  is: 


where 

c' 


R 


C'\CD /V 


(9) 


is  the  consumption  rate  of  the  fuel  in  pounds  of  fuel  per  hour 
for  each  pound  of  thrust 


is  the  lift  coefficient 
Cp  is  the  drag  coefficient 

Wq  is  the  initial  weight  of  the  plane,  including  fuel  and  cargo, 

in  pounds 


a  is  the  ratio  of  the  density  of  air  at  the  cruising  altitude  to  the 

mean  atmospheric  density  at  sea  level 

E  is  the  surface  area  of  the  wings  in  square  feet 


is  the  final  weight  of  the  plane  in  pounds,  including  cargo  and 
remaining  fuel,  on  landing.  It  is  the  sum 
W„  +  W_  +  PT  +  W  +  W_  wheie  W0  and  W„  are  the 
weights  allocated  to  the  enhancement  of  survivability  and 
reliability,  as  previously  defined;  p  is  the  payload,  or 
amount  of  cargo,  in  pounds;  Wp  in  tie  amount  of  aircraft 
weight  in  pounds  allocated  to  protection  against  threats,  as 
previously  defined;  and  W£  is  the  remaining,  essential 
empty  weight  at  the  end  of  a  mission. 


Since  the  payload  weight  remains  constant,  the  difference  between  the  initial  and 
final  weights  is  the  amount  of  fuel  (F^)  used,  namely: 


FR  ~  W0  "  W1 


(10) 


Therefore, 


ur  =  w  +  F 
w0  1  R 


WS  +  WR  +  PL  +  WP  +  WE  +  FR 


and  equation  (9)  may  then  be  written  as: 


(/ 


WS  +  WB  +  PL+WP+WE  + 


fr  -  A*wr(  pl*wp+we) 


(11) 
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The  nominal  range  given  by  this  equation  and,  hence,  also  the  probability  of  achieving 
any  given  range,  is  maximized  for  a  given  initial  weight,  final  weight,  altitude,  and 
fuel  consumption  rate  when  the  critical  drag  ratio,  =  (  yc^/Cp  )  is  maximized. 

The  drag  coefficient  (CQ)  depends  upon  the  lift  coefficient  approximately  according  to 
the  relation: 


CD  "  CDf  + 


~  CDf  + 


K/*v) 

(c£s/»rb2ej 


(12) 


where: 

is  the  drag  coefficient  projected  for  a  zero  lift  coefficient,  and 
is  due  to  skin  friction 

A  is  the  aspect  ratio,  which  is  the  quotient  of  the  square  of  the 

s 

wing  span  divided  by  the  wing  surface  area 
b  is  the  wing,  span  in  feet 


e  is  Oswald's  efficiency  factor,  which  accounts  for  variation  in 

drag  due  to  the  angle  of  attack  and  induced  drag  term.  Under 
normal  conditions,  e  is  close  to  one. 


The  critical  drag  ratio  (C  )  is  maximized  when  the  aspect  ratio  A  is  equal  to 
the  following: 


A 

s 


S 


3_ 

77 


eC 


Df 


(13) 
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When  this  equation  is  satisfied,  the  critical  drag  ratio  (CTir> 

Dn 

namely, 


)  reaches  its  maximum, 


(14) 


Equation  (9)  also  may  be  expressed  in  terms  of  the  initial  weight  (vVQ)  of  the  air¬ 
craft,  including  cargo  and  fuel,  as  follows: 


w0  -  (/wi  * 


era 


1181  J 


(15) 


Hence,  a  bare  minimum  of  fuel  (FR)  required,  in  pounds,  under  standard  conditions 
is  given  by: 


E 


W.  -  W. 
0  1 


Rc 

^DR 


sw 

1181 


+  r2c'2  ctS 
r2  1181 
CDR 


(16) 


In  the  presence  of  a  headwind  of  Vw  knots  and  an  average  airspeed  of  V,  equation 
(15)  can  be  modified  approximately  as  follows: 


The  airspeed  (V)  is  given  by  the  following  equation  under  the  condition  of  maximum 
range: 


V  -  y*295.  25  W/(crCLS) 


(18) 
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and  from  equation  (13), 


V  =  16.9  /w/(o  b  /^)  (19) 

where  the  constant  295. 25  is  the  conversion  from  statute  miles  to  nautical  miles  of 
the  constant  in  the  Breguet  range  equation,  and 

b  is  the  wing  span  In  feet, 

W  is  the  weight  of  the  aircraft  at  any  time,  and  as  an  approxi¬ 

mation  is  1/2  the  sum  of  WQ  and  Wj  ,  namely 

WS  +  WR  +  PL  +  WP+  WE  *  1/2  FR 

An  assumption  is  made  that  wind  velocity  is  normally  distributed  with  a  mean  of  zero 
velocity  and  a  standard  deviation  of  cr  knots.  Therefore,  the  probability  that  the 
wind  will  be  a  headwind,  and  that  the  headwind  component  will  exceed  3cn^y,  is 
0. 135%.  The  amount  of  fuel  (FR)  required  to  achieve  a  specified  range  (R')  in  spite 
of  a  30^^.  knot  headwind  is: 

Fr  =  2B  »/w  +  B2  (30) 

16.9  V  W 

Normally  the  required  fuel  capacity  will  be  greater  than  F_,  such  as  1.3  FD,  to 

r\ 

account  for  contingencies  other  than  headwinds. 

The  probability  of  achieving  a  specified  range  (R')  under  the  assumption  of  normally 
distributed  winds  can  be  calculated  according  to  the  following  steps: 

•  Calculate  R  according  to  equation  (9). 

•  Determine  the  margin  (R-R')/R. 


where: 
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to  obtain  the 


\ 


•  Multiply  this  margin  by  16. 9 
number  of  standard  deviations  for  wind  velocity. 

•  Convert  the  number  of  standard  deviations  to  a  probability  by  use  of  the 
normal  distribution.  For  example,  3  standard  deviations  correspond  to 
a  probability  of  .  99865. 


The  resulting  probability  is  that  of  achieving  the  required  range  (R')  subject  to  the 
achievement  of  safety  and  invulnerability  goals.  Fe»*  this  example,  capability  is  con¬ 
sidered  to  be  the  product  of  this  probability  and  the  parameters  of  safety  and  invul¬ 
nerability.  This  may  be  written  as: 


Capability 


_BL 


ob  yeCD£S  j 


VW 


(R  -  R'/'H) 


x  (Safety)  x  (Invulnerability) 


(21) 


where 

$  is  the  cumulative  probability  function  with 

*(t)  =  f  exp  [-x2/2j  dx  (22) 

-  QC 

Safely  is  assumed  to  be  0.  999 

Range  (R)  is  calculated  according  to  equation  (9) 

Invulnerability  is  defined  and  determined  as  below 

The  invulnerability  parameter  is  defined  as  the  probability  of  flight  survival  under 
hostile  threats.  It  is  considered  to  be  a  function  of  the  average  intensity  of  enemy 
threats,  the  amount  of  aircraft  protection  against  the  threats,  and  the  loss  in  total 
capability  of  the  fleet  resulting  from  the  loss  of  aircraft  because  of  their  vulnera¬ 
bility  to  the  threats.  Invulnerability  can  be  estimated  as  the  fraction  of  actual  fleet 
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capability  in  the  presence  of  an  enemy  threat  to  fleet  capability  without  this  threat. 
For  the  purpose  of  this  examplet  it  is  assumed  to  be  of  the  form; 

Invulnerability  =  ( 1  -  axp  [- XT]j/(\T)  (23) 


for: 

T  =  the  expected  operating  lifetime  of  the  aircraft  in  the  absence  of  an 
enemy  threat 

\  =  the  average  lethality  of  all  threats  per  hour  of  flight 


The  average  lethality  (\)  may  be  expressed  mathematically  as: 

ACRSL1  6X15  l‘klWR/ACRS  I  +  3600  L2  6X15  I  "VV^CRS  | 

+  RAD  L3  GXP  I  k3WS^ACRs]  *24) 


where: 


ACRS  iS  the  surface  area  of  t*ie  aircraft  in  square  feet 

is  the  average  number  of  lethal  rounds  per  second  of  a  light  threat 
in  the  path  of  flight,  under  the  assumption  of  no  protection  against 
this  threat 


Wp  is  the  amount  of  protection  and  shielding  afforded  against  the 
average  threat,  in  pounds 


W, 


R 


Wf 


as  previously  defined 


is  the  efficiency  of  the  protection  in  combating  a  light  threat,  in 
units  of  square  feet/pounds 

is  the  average  number  of  lethal  rounds  of  a  moderate  threat  per 
second 


k2  is  the  euioicncy  of  the  protection  against  the  effects  of  a  moderate 

threat,  in  units  of  square  feet/pounds 
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L„  is  the  average  intensity  of  a  heavy  threat,  in  mllliroentgens 

u 

per  hour 

RAD  is  the  Probability  that  the  aircraft  '.vill  be  disabled  during  any 
time  that  it  is  unprotected  from  a  heavy  threat  exposure 

k  is  the  efficiency  of  the  protection  against  a  heavy  threat,  in 

u 

units  of  square  foci/ pounds 
Capability  Parameter  for  FOM  (2) 

The  transfer  functjc:.  of  the  capability  parameter  (C)  for  the  FOM  (2)  measure  (the 
average  number  of  ton-miles  of  cargo  delivered  per  aircraft  per  day  over  the  life¬ 
time  of  all  aircraft  in  the  fleet)  is  considered  to  be: 

C  =  (Ton  nautical  miles  per  day,  conditional  upon  aircraft  availability  and 
dependability)  x  (Safety) 

Since  ton-nautical  mileage  per  hour  is  physically  the  product  of  flight  velocity  in 
nautical  miles  per  hour  (knots)  and  the  number  of  tons  of  payload  carried,  and  there 
are  24  potential  flight  hours  per  day  under  perfect  availability,  then: 

C  =  (Payload  in  tons)  x  (Velocity  in  knots)  x  (Safety) 

Using  the  relationship  of  equation  (18),  the  approximation  for  W  in  equation  (19), 
the  weight  of  the  aircraft  at  any  time,  and  the  conversion  of  pound  payload  to  ton 
payload,  then: 

C  =  (0. 012)  PL  y  295.  25  (Wg  +  WR  +  PL  +  Wp  +  W£  +  £  FR)/aCLS 

x  (Safety)  (25) 

From  equation  (11),  the  fuel  required  (Fp)  in  equation  (25)  may  be  related  approxi¬ 
mately  to  other  previously  defined  parameters  and  accountable  factors  of  range  as 
follows: 


Fn  -  | x2  +  x 


i ; 


WS  +  WR  +  ‘•l  +  WP  +  WE  '  7 


(26) 
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with 


X  *  R'c!  OCq/Cl  |  +  |  CL3/ffb2e])/y295725/<7CLS 
Figures  of  Merit 

Each  of  the  FOMs  used  in  this  example  is  assumed  to  be  a  product  function  of  avail¬ 
ability,  dependability,  and  capability.  FOM  (1)  is  the  probability  of  achieving  a  basic 
long  range  mission  of  R'  nautical  miles  with  a  payload  of  PT  pounds.  It  is  equal  to 
the  product: 

Availability  x  Dependability  x  Capability  (27) 

where: 

Availability  is  calculated  according  to  equation  (3) 

Dependability  is  calculated  according  to  equation  (8) 

Capability  is  calculated  according  to  equation  (21) 

FOM  (2)  is  the  expected  number  of  ton-nautical  miles  per  day  of  cargo  moved.  It  is 
also  equal  to  the  product: 

Availability  x  Dependability  x  Capability  (28) 

where: 

Availability  and  dependability  are  the  same  as  for  FOM  (1) 

Capability  is  calculated  according  to  equation  (25) 

Cost  Effectiveness  Measure 

The  cost  effectiveness  measure  is  defined  restrictively  for  illustration  purposes, 
and  is  the  ratio  of  FOM  (2)  to  total  operating  costs  per  day  (the  cost  effectiveness 
measure  for  FOM  (1)  is  similar  and,  therefore,  is  not  illustrated).  For  simplicity, 
the  total  costs  are  divided  into  three  defined  categories: 

(1)  Fixed  costs  per  day  (Cj),  such  as  interest  on  aircraft  production  cost 
and  depreciation  which  is  independent  of  aircraft  usage.  Part  of  the 
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cost  of  producing  an  aircraft  in  the  cost  of  making  it  readily 
maintainable.  For  purpose  of  trade-off,  the  relationship  between 
maintainability  and  cost  is  assumed  to  be  according  to  the  following 
formula: 


C1  "pi3"0  +  2r,'000j  (29) 

where  the  constants  are  sensitivity  coefficients  of  the  relationship 
between  fixed  acquisition  cost  per  aircraft  and  msinterance  man¬ 
hours  per  flight  hour. 

(2)  Total  maintenance  costs  per  day  (C2),  with 


C2  ~  Mmh  C3  Ft 


(30) 


where: 

C3  is  the  average  maintenance  cost  per  manhour. 

Mmh  and  Ft  are  as  previously  defined. 

(3)  The  daily  nonfixed  costs  (C„),  the  portion  of  operating  costs  relating 

O 

to  aircraft  usage,  with 


C6  ‘  Ft  C4  C5 


where: 

is  the  fuel  and  related  costs  per  pound  of  fuel. 
C5  is  the  total  fuel  and  related  cost,  with 


(31) 


C5  =  c 


.  (2m.  +  2±L\  (■ 

\CL  ,b2eM 


WS  +  WR  +  PL  +  WP  +WE  +  2 


JFn) 


(32) 
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Total  co'jL  (Cq)  is  then 


C  = 


C1  +  S  +  C6 


X^P-  +  2() 


M 


mh 


•( 


— F  \ 
2  R/ 


WS  +  WR  +  PL  +  WP  +  WE  + 


Therefore,  cost  effectiveness  (CE)  ic 


(33) 


(CE)  =  FOM  (2)/Total  Cost 
=  ADC/C 


(34) 


whore: 

A  is  given  by  equation  t'3) 

D  is  given  by  equation  (8) 

C  is  given  by  equation  (25) 

CQ  is  given  by  equation  (33) 

8.  SYSTEM  AND  COST  EFFECTIVENESS  ANALYSIS 

Throe  separate  analyses  will  be  required.  These  are: 

•  Tho  determination  of  values  for  all  free  accountable  factors  and 
parameters  such  that  FOM  (1)  is  maximized. 

•  Tho  determination  of  values  for  all  free  accountable  factors  and 
parameters  such  that  FOM  (2)  is  maximized. 

•  Tho  determination  of  values  for  all  free  accountable  factors  and 
parameters  such  (hat  (CE),  the  quotient  of  FOP*  2)  divided  by  tho 
sum  of  all  costs,  is  maximized. 

At  tho  outset,  some  direct  optimizations  may  bo  made.  For  example,  tho  systom 

availability  parameter  for  either  FOM  measure  can  bo  calculated  direotly  from 

equation  (3).  Alno,  lifting  conations  (12,  and  (13),  tho  optimum  wing  span  cm  be 
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approximately  derived  based  on  the  assumed  values  for  the  lift  coefficient,  the 
projected  drag  coefficient,  and  Oswald's  efficiency  factor.  However,  other  values  of 
accountable  factors  and  parameters  are  not  directly  calculable  and  will  require  an 
iterative,  composite  analysis  to  determine  thei  best  combination  of  values  so  that  the 
dependent  FOM  or  CE  measure  is  maximized. 

The  results  of  the  three  separate  analyses  to  establish  the  optimum  values  for  the 
involved  free  accountable  factors  and  parameters  are  summarized  in  Tables  A-5  and 
A-6.  Additionally,  the  numerical  values  for  the  sensitivity  of  the  critical  parameters 
to  changes  in  contributing  parameters  and  accountable  factors  are  given  in  Table  A-7. 
This  table  represents  an  updating  of  Table  A-4  in  paragraph  6,  and  is  obtained  by 
differentiating  the  equations  (transfer  functions)  given  in  paragraph  7. 
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TABLE  A-5  CALCULATED  VALUES  FOR  FOM  (1) 


Figure  o f  Merit:  The  probability  of  achieving  a  basic  long  range  mission  with  a 
specified  payload. 

Accountable  Factor/ 
Parameter  Value 


Flight-hours  per  day  (Ft) 


0.714 

17 . 1  hours/day 


Reliability 


Survivability 


0.939 

0.988 

0.950 


Capability  (C) 

Final  weight  (W^) 

Wing  span  (b) 

Drag  coefficient  (CD) 

Velocity  of  flight  for  maximum  range  (V) 

Range  in  still  air  (R) 

Weight  allocated  to  reliability  (W^) 

Weight  allocated  to  survivability  (Wg) 

Allocation  of  payload  to  protection  against  threats  (Wp) 


0.996 

556,500  pounds 
215  feet 
0.04 

511  knots 

4,570  nautical  miles 
3, 800  pounds 
700  pounds 
2, 000  pounds 


FOM  (1) 


0.  068 
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TABLE  A-6  CALCULATED  VALUES  FOR  FOM  (2) 


Figure  of  Merit:  The  average  number  of  ton-miles  of  cargo  delivered  per  aircraft 
per  day  over  the  lifetime  of  all  aircraft  in  the  fleet. 

Accountable  Factor/ 
Parameter  Value 

For  Max.  FOM  For  Max.  CE 


(with  fixed  M^) 

(without  fixed 

Availability  (A) 

0.714 

0.775 

Flight  hours  per  day  (Fj 

Actual  direct  maintenance  manhours 

17. 1 

18.  6  hours/day 

per  aircraft  flight  hour  (M^) 

4.0 

2.4 

Dependability  (D) 

0.936 

0. 936 

Reliability 

0.986 

0.986 

Survivability 

0.949 

0,949 

Capability  (C) 

1,517,000 

1,517,000  ton-miles/ 
day 

Wing  span  (b) 

215 

215  feet 

Drag  coefficient  (C^) 

0.04 

0.04 

Payload  (PL) 

248,000 

248,000  pounds 

Weight  allocated  for  reliability  (WR) 

1,600 

1, 600  pounds 

Weight  allocated  to  survivability  (WgJ 

0 

0  pounds 

Total  Cost  (C  ) 

.__o_ 

$99,600 

$102, 000/day 

Fixed  daily  cost  {Cj) 

$24, 100 

$  26,70l)/day 

Maintenance  cost  (C9) 

$  1,710) 

$  1, 710/day 

Fuel  and  related  cost  (C  .) 

t>' 

$73,800 

$  73, 800/day 

FOM  (2) 

1,014,000 

1, 100,  000  ton-milos/ 
day 

Cost  Effectiveness 

10,  2 

10.  8  ton-miles/ 
dollar 
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TABLE  A- 7  CALCULATED  SENSITIVITY  RELATIONSHIPS 


1  pound  change  in  payload  =  4. 0  ton-nau*ical  miles  per  day 

0.  001  unit  of  survivability  =  1000  ton-nautical  miles  per  day 

1  pound  of  protection  =  1.5  x  10  unit  of  unvulnerability 

1  pound  of  protection  =  1.0  pound  of  payload 

1  foot  cruising  altitude  =  15  ton-nautical  miles  per  day 

0.001  unit  fuel  consumption  rate  coefficient  =  -14  nautical  miles  range 

1  foot  cruising  altitude  =  0. 068  nautical  mile  range 

280  pounds  payload  =  -1  nautical  mile  range 

0.001  unit  lift  coefficient  =  4.5  nautical  miles  range 

0. 001  unit  drag  coefficient  =  -180  nautical  miles  range 

C.  001  unit  fuel  consumption  rate  coefficient  =  $231.  oi  fuel  cost  per  day 

1  pound  payload  =  $0. 059  of  fuel  cost  per  day 

0.  001  unit  lift  coefficient  =  $73. 80  of  fuel  cost  per  day 

0,  001  unit  drag  coefficient  due  to  skin  friction  =  $2,  960.  of  fuel  cost  per  day 
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Comments  on  FOM  (1)  Analysis  Results 

The  range  parameter  is  the  principal  system  parameter  contributing  to  the  FOM  (1) 
measure.  The  established  goal  for  this  parameter  to  guide  conceptual  studies  was  a 
minimum  of  4,000  nautical  miles.  A  minimum  range  capability  in  still  air  of  4, 570 
nautical  miles  was  analytically  determined  to  be  required  and  obtainable  for  the 
example  transport  concept.  This  higher  design  range  value  compensates  for  expected 
headwind  conditions.  Further,  the  probability  of  achieving  the  FOM  was  determined 
to  be  0.  668,  short  of  the  wartime  mission  goal  of  0. 70  by  0. 032.  Many  options  are 
available  to  overcome  this  deficiency.  For  example,  operational  tactics  can  be  modi¬ 
fied  to  provide  tactical  aircraft  support  to  neutralise  anticipated  enemy  threats,  thereby 
increasing  the  transport's  inherent  invulnerability,  and  correspondingly,  its  FOM 
measure. 

The  estimate  of  0.714  for  the  availability  parameter  is  based  upon  a  measure  which 
considers  the  potential  maximum  utilization  of  each  transport  for  a  24  hour  operating 
day.  This  primarily  addresses  an  emergency,  wartime  plan  for  continuous  usage. 

For  peacetime  or  limited  war  missions  where  usage  demands  are  not  as  severe,  a 
lesser  amount  i.i  maintenance  is  anticipated.  Consequently,  a  higher  availability 
value  car.  be  expected  (e.g. ,  if  the  transport  usage  baseline  is  an  average  of  12  hours 
per  day,  transport  availability  will  be  close  to  one).  Coupled  with  a  companion,  anti¬ 
cipated  increase  in  system  survivability  due  to  infrequently  expected  enemy  threats 
for  the  peacetime  or  limited  war  mission,  the  goal  of  0.  98  for  the  FGM  (1)  for  this 
mission  is  reasonably  attainable. 

Comments  on  FOM  (2)  Analysis  Results 

Two  values  were  obtained  for  the  FOM  (2)  measure  of  the  number  of  ton-miles  of  cargo 
moved  per  day.  One  was  for  a  maximum  system  effectiveness  criterion  without  (he 
presence  of  major  cost  alternatives,  The  other  was  for  an  optimum  cost  effectiveness 
criterion. 
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In  each  case,  the  value  obtained  was  approximately  three  times  the  specified  goal  of 
340, 000  ton  -miles  because  the  analysis  was  addressed  to  the  most  severe  operational 
demands.  These  demands  are: 

•  Each  aircraft  is  to  be  fully  utilized  each  day  except  for  that  portion  of 
a  day  when  it  is  undergoing  maintenance. 

•  Each  aircraft  is  to  carry  a  full  load  of  cargo  on  each  flight  to  and  from 
a  specified  destination. 

Both  of  these  operational  demands  for  full  utilization  of  each  aircraft  occur  only  in 
emergency  and  sustained  wartime  situations.  Even  in  such  instances,  it  is  still  not 
anticipated  that  each  transport  will  fly  a  return  trip  with  a  full  cargo  load.  Thus, 
when  considering  a  more  realistic  mission  of  a  transport  to  be  utilized  an  average  of 
12  hours  a  day  and  to  fly  empty  one- third  of  its  total  flight  time  (with  the  other  two- 
thirds  of  the  time  fully  loaded),  then  the  transport  system  will  be  capable  of  moving 
approximately  350,000  ton-miles  per  day,  exceeding  the  specified  goal  of  340,000. 

The  goal  of  250,  000  pounds  for  payload  is  missed  by  0. 8%.  Design  or  operational 
alternatives  are  available  to  achieve  the  goal,  such  as  flying  at  a  higher  cruise  alti¬ 
tude  or  in-flight  refueling  provisions  so  that  less  fuel  will  be  required  to  be  carried. 


Appendix  B 

SYNTHESIS  AND  ANALYSIS  METHODS  FOR  DETERMINING 
TRANSFER  FUNCTIONS,  OUTPUTS,'  AND  INPUTS 


Introduction 


This  appendix  summarises  the  synthesis  and  analysis  procedures  to  be  used  to 
establish  transfer  functions  and  to  evaluate  measures  of: 

•  Figures  of  Merit  (FOMs) 

•  Effectiveness  parameters  of  availability,  dependability,  and  capability 
■  System  parameters  integrated  by  the  effectiveness  parameters 

•  First-level  accountable  factors  (design  variables) 


Depending  on  the  level  to  which  the  synthesis  and  analysis  are  being  addressed, 
each  of  these  measures  may  be  evaluated  as  an  output  of  transfer  functions  for 
defined  inputs.  Output-input,  relationships  may  be  ns  follows: 


Output 
•  FOM 


•  Effectiveness  parameters 

•  by  stem  parameters 

•  First, -level  accountable 
factors 


Input 

Effectiveness  parameters,  system 
parameters,  or  first-level  accountable 
factors 

System  parameters  or  first-level 
accountable  factors 

First-level  accountable  factors 

Lower-level  accountable  factors 


\ 
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Part  B1  -  Synthesis  Method 

The  synthesis  method  can  be  applied  to  determine  optimum  transfer  functions,  given 
knowledge  only  of  the  inputs  and  required  outputs.  Additionally,  this  method  will 
allow  for  the  development  of  a  block  diagram  for  the  system  having  these  transfer 
functions.  The  result  is  that  an  optimum  system  can  be  selected  from  a  set  of 
possible  systems  without  analyzing  each  candidate  system  in  the  set.  The  synthesis 
method  is  inherently  more  difficult  that  the  analysis  methods  described  in  Parts  B2 
and  B3  of  this  appendix,  which  can  be  used  to  find  the  optimum  input  or  output  values, 
given  the  set  of  transfer  functions.  Further,  there  is  a  possibility  that  the  set  of 
transfer  functions  may  not  exist  in  a  form  suitable  for  analytical  use.  There  also 
is  the  fundamental  design  problem  cf  finding  a  physical  representation  for  the  system 
with  the  optimum  set  of  transfer  functions. 

The  synthesis  method  is  simplified  ii  me  systciTi  k-ua  b linearised  and  the  time- 
varying  elements  are  not  complex.  Where  complexity  exists,  the  method  is  useful 
to  obtain  approximate  optimum  systems. 

A  commonly  occurring  transfer  function  applicable  to  delayed  response  is  one  which 
is  in  the  iorm  of  the  superposition  (convolution)  integral.  This  integral  is: 


y(t)  = 


/ 


g(t,r)  x(r)  dr, 


(1) 


where 

t  is  time, 

y(  t)  is  an  analytically  obtained  output  function  of  time, 
g(t,  t  )  is  the  impulse  response  transfer  function  relating  y(t)  to  x(  T  ) , 
x(t)  is  an  input  function  of  r  ,  which  in  turn  is  a  variable  of  integration 
having  the  dimension  of  time. 

Giver,  this  superposition  integral  relationship,  a  known  input  function  x(r),  and  a 
desired  (known)  output  function  t ) ,  a  procedure  is  available  for  determining 

the  transfer  i'unedon  g(t,  T)  which  will  result  in  an  actual  output  function  v(t) 
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as  closely  as  possible  to  the  desired  output  function  p(t).  This  procedure  is 
as  follows: 

(1)  Establish  a  criterion  for  determining  the  closeness  of  fit  of  y(  t) 

to  p(  t) ,  such  as  developing  a  system  that  will  produce  the  smallest 
error  j£f(t)  -  y(t))  in  a  mean-squared  sense.  Mathematically  this 
criterion  can  be  a  minimum  expected  value  E  expressed  as: 

E^j/r(t)  -  y(t)J2j  =  Minimum 

Another  criterion  is  that  the  time-averaged  mean-square  error  is  a 
minimum. 

(2)  Define  an  autocorrelation  function  0xx(t,  T)  and  a  cross-correlation 
function  0^x(t,  r)  which  represent  the  expected  value  of  x(t)  x(r) 
and  /<(t)  x{T),  respectively.  In  most  applications,  these  functions 
can  be  sufficiently  approximated  by  linear  combinations  of  functions 
aq(t)>  bq(t),  and  Cq(t)  such  that: 

Q 

^xx(t’T)  =  Vt)bq(T)  “  7'^Lt 

q  =  l 

Q 

^xx(t’T)  =  Xfaq(T)  bq(t)  if  T>t 
q  =  l 

Q 

^x{t^> =  Evi)vr) 

q  =  l 

From  equation  (  1),  establish  the  following  integral  relations: 

t 

<?^x(  t,T)  =  J  E< t ,  cr )  <^»xx< T  ,  cr )  d cr 

0 

where  cr  is  a  variable  of  integration. 
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Express  the  equations  for  <f>  (t,r)  and  A  (t,  t) 

XX  fJL  X 

notation  as  follows: 


in  vector 


^xx(t’  T)  =  Kt>‘£<T>  if  T^t 
-  a(T)  •  b(t)  if  t  >  t 

^x<t.  T)  =  c(t)  •  b(  T) 

where  a(t)  is  the  vector  Ja^t),  .  .  .  ,  aq(t)]  .  and  the  vectors 
b(t)  and  c(t)  are  similarly  defined  as  Q-th  order  vectors. 

(3)  Find  Q-th  order  vectors  t )  and  Y(t)  such  that: 


g(t,T)  -  £(t)  •  z(t)  «(t  -r  ) 

with 


U(t  —  T  )  =  1  if  t>T 
=  0  it  t<T 
This  is  accomplished  by  the  following: 

(a)  Define  the  function  I  ,  where: 

t 


v(t)  = 


L 


VT) 


7p(r)  dr 


(b)  Define  the  function  w(t  -  T),  where: 

w(t  -  T)  =  [ a ( t )  b(T)  -  a(r)bft)] 

This  function,  in  most  applications,  depends  on  (t  -  r  )  alone. 

(c)  Define  the  Laplace  transform  W(x)  and  B(s)  of  w(t)  and 
b(t),  respectively,  where; 


w(t)  dt 
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W(  s) 


E 


(d)  Define  the  vector  function  /""( s ) ,  where 

2T<  s)  =  B(s)/W(s) 

(e)  Determine  the  vector  function  y(r) ,  which  is  the  inverse 
Laplace  transform  of  H(s),  where: 

a+  icn 

2(t)  =  ±  f  eSTn*)  ds 

a-ico 

with: 

‘  -  ip-  ,  and  a  is  a  real  number  located  to  the  right  of  all 
singularities  of  JT(s)  in  the  complex  plane. 

(f)  Determine  the  functions  g^(t) ,  .  .  .  ,  gQ(t)  ,  which  are  the 
elements  of  the  vector  g(t  )  ,  by  solving  a  system  of  equations. 
In  matrix  form,  these  equations  are 


where  the  symbol  (t)  has  been  omitted  I'm  ail  I,  g,  mid  o 
elements  for  brevity. 


(4)  Determine  the  impulse  response  transfer  function  g(t,  r)  by 
evaluating  the  following  equations: 

g(t.  T)  =  [g(t)  •  y(r)]  u(t  -  r  )  +^hk(t)  5(k)(t  -  r)  , 

k 

where 

h^(  t )  may  be  chosen  in  an  arbitrary  manner  to  simplify 
g,  and 

( k' 

5'  '(t  -  r)  represents  the  k-th  derivative  of  the  translated  unit 
impulse  function. 

By  setting  each  h^ft)  to  zero,  one  particular  solution  for  g(t,  r  )  can 
be  obtained. 

(5)  Establish  an  optimum  block  diagram  representation  of  the  system 
configuration  based  on  the  determined  function  g(t ,  r  ) . 
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Part  B2  —  Analysis  Method  I 

The  analysis  method  I  can  be  applied  to  determine  an  optimum  output,  y(t)  , 
given  knowledge  of  the  input  function  x(  r  )  and  the  transfer  function  g(t,  r)  . 

The  general  form  for  a  time-delayed  response  function  is  the  superposition  integral 
of  equation  (1),  which  is: 

t 

y(  t )  -  /  g(  t ,  r  )  x(  r )  dr 
0 

If  g(t  ,  r)  is  of  the  form  where  it  is  a  product  of  functions  of  single  variables, 
then  g(t,r)  can  be  expressed  as: 

g(t,  T)  =  a (r)  g(t  -  r ) . 

Equation  (1)  then  will  take  the  following  form: 

t 

y(t)  ~  /  x(r)  a(r)  g,t  -  r)  dT,  (2) 

0 


where 

a(  T )  is  a  time  variable  gain  element  and 
g(t  -  T)  is  a  time-delay  function  (impulse  response  transfer  function) 

Figure  B-l  is  the  analog  representation  of  equation  (2). 


Figure  B-l 
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Direct  computation  of  the  optimum  output  y(t)  using  equation  (2)  is  difficult,  especially 
if  the  impulse  response  transfer  function  g(t  -  T)  is  determined  empirically,  or  as 
the  result  of  analog  computations.  An  alternate  procedure  is  to  formulate  the  adjoint 
to  equation  ( 2  )  and  Figure  B-l.  This  adjoint  is  mathematically  equivalent  and  is: 

t 

y(t)  =  j  x(t  -  r)  a(t  -  7  )  g(T)  dr  (3) 

0 

This  equation  is  more  convenient  to  evaluate  than  the  original  equation  (2)  in  appli¬ 
cations  where  all  that  is  known  of  the  input  x(  t  -  r )  is  that  it  is  a  random  variable 
with  a  particular  distribution.  Figure  B-2  is  the  analog  representation  of  this 
adjoint  equation. 


JV(t)  1 

^X(t-T)  a(t-  T)  g(T<  .  !  .  a(t-T)  g(-) 

a(t-T) 

£(T) 

- 

G(s; 

,  <5  <T)_ 

X(t-T)— - 7-“- 

* - Adjoint  of  Figure  B-l- 


Figure  B-2 


The  chief  differences  between  the  original  system  and  its  adjoint  system  are  that 
(1)  in  the  analog  representation,  the  time  function  is  reversed,  and  (2)  the 
operators  G(s)  and  a(  t)  are  applied  in  reverse  order.  The  advantage  of  the 
adjoint  system  is  that  the  operator  G  is  applied  to  the  input  first,  and  the  result 
then  applied  to  an  ensemble  of  inputs  x(t  -  T)  . 

For  example,  the  input  ensemble  x(t  -  t)  may  be  random  with  mean  m(t  -  t) 
and  standard  deviation  a  (t  -  r)  .  If  m^(  t)  and  <7^(t)  are  the  mean  and  standard 
deviations  .respectively,  of  the  output  function  y(t),  then  the  adjoint  equations 
corresponding  to  equation  (3)  are: 


m 


1 


m(t  -  r)  a(t  -  t)  g(  r)  dr 
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output 


multiply 


Figure  B-3 


The  adjoint  representation  saves  computation  labor  in  that  the  common  operatm 
G(s)  is  applied  before  the  branching  of  the  network  into  multiplication  operations. 
The  multipliers  of  the  example  network  are  the  mean  input  m(t  -  r  )  and  the 
standard  deviation  cr  (t  -  r )  of  the  input. 
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Part  B3  -  Analysis  Method  n 


The  analysis  method  II  can  be  used  to  address  the  problem  of  determining  input 
x(t)  if  the  desired  values  of  a  time  varying  output  function  y(  t)  and  the  transfer 
function  g(  t ,  t)  are  known,  where  y(t)  can  be  expressed  as: 


y(t) 


g(t,T)  X(T)  dr 


(4) 


In  many  applications,  the  output  is  a  time  varying  response  function  dependent 
upon  an  input  or  input  ensemble,  and  expressible  as- 


y(t)  =  a  e  ct  + 


t 

y*  e"c(t"T)  x(r)  dT, 
0 


where 

a  is  the  value  of  y  when  time  (t)  is  zero,  and 

c  is  a  constant  which  indicates  how  fast  the  output  response  is  damped. 

The  solution  for  the  op  imum  input  function  involves  the  use  of  Laplace  transforms, 
and  is: 


x(t)  =  +  ^(0+)  i(t)  +  cji(t)  -  ai(t) 


where 

fj( 0+)  is  the  value  of  u  when  t  is  zero.  If  there  is  a  jump  in  fi  at 

t  =  0,  m0+ )  means  the  value  of  n  immediately  ;  iter  this  jump. 

d(t)  is  an  impulse  function  with  a  value  of  l/e  if  t  is  between  0  and 
€ ,  and  is  otherwise  0  ,  where  f  is  a  small  postive  number. 
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A  more  general  problem  which  can  be  solved  by  this  method  is  to  determine  the  input 
function  x(t)  and  the  output  function  yft)  such  that  equation  (4)  and  the  following 
differential  equation  are  satisfied 


ddft'^  =  b(t)y(t)  +  c(t)x(t>, 


where  b(t)  and  c(t)  are  specified  functions  of  time. 

Subject  to  these  requirements,  the  input  and  output  functions  should  be  as  close  as 
possible  to  stipulated  desired  input  and  output  functions  y(£)  and  respectively. 

Mathematicallj ,  this  implies  minimizing  the  following  function  J  : 

T 

J  f  "  y(4>]2  +  D  -  XU)]2J  d^. 

0 

where 

c p(  £  )  and  <,!'{ £  )  are  weighting  functions  relating  the  relative  importance  of 
matching  oveput  and  input  functions,  respectively,  to  the 
desired  values  of  these  functions,  and 

T  is  the  length  of  the  time  interval  during  which  the  input  and 
output  functions  are  required  for  the  system.  Time  t  is  0 
and  T  at  the  beginning  and  end,  respectively,  of  this  interval 


The  procedure  for  determining  the  required  input  function  x(t  )  and  output  function 
y(t)  is  as  follows: 

(1)  Define  functions  k 3 ( t )  and  k,,(t)  such  that  the  following  equations  are 
satisfied: 


kj(T)  =  k2(T)  =  0 


'&4>H  -  bk^  -  2  ck2  Y  + 


c2kiR2 


4> 


B-ll 


-<t>  -  2b  kg  + 


2.2 
c  k2 

4> 


where  k,  means  kjt),  k„  means  k0{t),  tf>  means  0(t),  etc. 

1  X  4 1  4 

In  order  to  determine  k1  and  k2>  the  last  two  equations  must  be 
integrated  backward  from  T  to  0  . 

(2)  Determine  input  x(t)  and  output  y(  t)  by  integrating  forward  from  0  to 
T  to  solve  the  following  equations  simultaneously: 

*  ‘  *  -  Mkl  +  2k2  5]  ! 

^  =  bv  +  ex, 


where  all  quantities  are  function  of  time  t . 
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Appendix  C 

COMBINATION  OF  SENSITIVITY  FUNCTIONS 


This  appendix  describes  the  detail  procedure  for  combining  sensitivity  functions 
relating  accountable  factors  to  the  effectiveness  parameters  of  availability,  depend¬ 
ability,  and  capability  with  sensitivity  functions  that  relate  these  effectiveness 
parameters  to  a  Figure  of  Merit.  The  procedure  is  equally  applicable  to  the  combi¬ 
nation  of  sensitivity  functions  associated  with  more  than  two  design  levels. 

The  changes  (4.  A),  (4.D),  and  (A.C  )  in  the  system  effectiveness  parameters 
X  j  K 

of  availability  (A),  dependability  i  D),  and  capability  (C),  respectively,  due  to 
changes  in  accountable  factors  ct.,/3.,  and  y  from  their  nominal  values  by  amounts 
(Aa.),  (A0),  and  (4>v),  respectively,  can  be  represented  by  sensitivity  functions 

1  J  K 

of  the  following  types: 

A  =  a.(4a.)  +  (terms  involving  higher  powers  of  (da.))  ; 

4j  D  =  dj(4/?j)+  (terms  involving  higher  powers  of  (Af3^))  ; 

A^C  =  ck(Ayk)  +  (terms  involving  higher  powers  of  (4yk)l  ; 

"  where 

a.  is  the  i-th  accountable  factor  influencing  the  availability  parameter ; 
ft.  is  the  j  —  th  accountable  factor  influencing  the  dependability  parameter; 

J 

yk  is  the  k-th  accountable  factor  influencing  the  capability  parameter; 


and 

a.  ,  d.  ,  and  c.  are  partial  derivatives  of  the  availability,  dependability, 
and  capability  parameters  with  respect  to  their  accountable  factors.  These 
partial  derivatives  describe  the  slope  representing  the  ratio  of  the  changes 
in  availability,  de^ndability,  and  capability  to  the  changes  in  their  respective 
accountable  factors  ctj,  and  yk . 
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If  the  same  accountable  factor  influences  more  than  one  of  the  Bystem  effectiveness 
parameters  of  availability,  dependability,  and  capability,  it  will  appear  in  more  than 
one  of  the  three  accountable  factor  sets  of  a  ,  0  ,  and  y  . 

The  total  changes  (dA),  (dD),  and  (dC)  in  a  system  effectiveness  parameter 
of  availability,  dependability,  or  capability  due  to  the  changes  in  all  of  its  accountable 
factors  can  be  considered  as  the  sum  of  changes  arising  from  individual  charges  in 
the  accountable  factors,  plus  nonlinear  terms  to  relate  the  interactive  effect  of  changes 
in  two  or  more  accountable  factors.  Hence, 

dA  =  a1(4c<i  )  -r  a ^(Aa^)  +  •  •  •  +  a^dcij)  +  [terms  involving  higher 
powers  of  the  (  dm  )'sj ; 

dD  =  dj(d&)  +  d 2(d/?2)  +  •  *  •  +  dj(A0j)  +  ( terms  involving  higher 
powers  of  the  (A0)' sj  ; 

dC  =  c^  Ay j)  +  c^(  A y,^ )  +  •  •  •  +  c^(  dy^)  +  [terms  involving  higher 
powers  of  the  (dy)'s)  j 

where 

I ,  J ,  and  K  are  the  number  of  accountable  factors  which  influence  availability, 
dependability,  and  capability,  respectively. 

The  top-level  effectiveness  function  also  may  be  approximated  by  sensitivity  functions 
that  will  relate  the  change  dE  in  the  Figure  of  Merit  from  its  nominal  value  to  the 
changes  dA,  dD,  and  dC  in  availability,  dependability,  and  capability,  respectively, 
from  their  nominal  values.  The  combined  effect  of  all  these  sensitivity  functions  can 
be  expressed  by  an  equation  of  the  following  type: 

dE  =  e^dA)  +  e^(dD)  +  e3(  dC)  +  [terms  involving  higher  powers  of 

dA,  dD,  and  dC  )) , 

where 

e^,  e2 ,  and  e^  are  the  slopes  representing  the  ratios  of  the  change  in  the 
Figure  of  Merit  caused  by  a  change  in  availability,  dependability,  and  capability 
to  the  amount  of  change  in  availability,  dependability,  and  capability,  respectively. 
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The  formulas  may  be  combined  mathematically  to  yield  a  single  formula  for  the 
sum  of  the  sensitivity  functions.  This  formula  will  relate  the  changes  in  accountable 
factors  from  their  nominal  values  to  changes  in  the  Figure  of  Merit  from  its  nominal 
value,  namely, 


AE  =  a1  e1(4a1  )  +  a2  +•••-«!  e^Oj) 

+  dx  e2(4^)  +  d2  e2(A02)  +  •  •  ■  +  dj  e2(^j) 

+  Cj  e3(  Ayy)  +  c2e3(  Ay2)  +  ■  •  *  +  e3(4yK) 

t 

+  (  terms  involving  higher  powers  of  the  (4a)'s  : 
(4/?)' s,  and  the  (4y)'s)„ 

Additionally,  the  formula  may  be  used  to  determii  3  the  combination  of  changes  in 
one  or  more  of  the  accountable  factors  that  would  result  in  the  largest  increase  in 
the  Figure  of  Merit  without  violating  an y  design  restrictions  or  requirements  which 
may  be  placed  upon  the  accountable  factors. 
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Appendix  D 

APPORTIONMENT  PROCEDURES 


X. 


Introduction 

XhAfi  appendix  Biimmarlzes  the  nrocechire  tja  be  used  fr  l^plem^nt  selected  methoda 
for  apportioning  system  effectiveness-related  measurer*  of; 

•  Figures  of  Merit  (FOMs) 

•  Effectiveness  parameters  of  availability,  dependability,  and  capability 

•  System  parameters  integrated  by  the  effectiveness  parameters 

•  First-level  accountable  factors  (design  variables) 


Depending  on  the  level  to  which  the  effectiveness  apportionment  analysis  is  being 
addressed,  each  of  these  measures  may  be  evaluated  as  outputs  of  transfer  functions 
for  defined  inputs.  Output-input  relationships  may  be  as  follows: 


Output 


Input 


•  FOM 

•  Effectiveness  parameters 

•  System  parameters 


Effectiveness  parameters,  system 
parameters,  or  first-level  accountable 
factors 

System  parameters  or  first-level 
accountable  factors 

First-level  accountable  factors 


•  First-level  accountable 
factors 


Lower-level  accountable  factors 


The  apportionment  analysis  process  basically  involves  the  determination  of  the  best 
values  for  the  input  ensemble  which  will  optimize  the  output  being  analyzed.  Upon 
establishment  of  the  optimum  output  value,  the  corresponding  values  of  the  inputs 
associated  with  this  optimum  are  the  desired  apportioned  values. 


Methods  for  optimizing  an  output  measure  subject  to  mission  or  system  performance 
constraints  include  the  (1)  Lagrangian  method,  (2)  Lagrangian  method  with  priority 
lists,  (3)  dynamic  p-ogramming,  (4)  direct  comparison  (direct  search),  (5)  linear 


D-l 


programming,  (6)  gradient  projection,  and  (7 )  calculus  of  variations.  A  general 
mathematical  overview  of  methods  (1),  (3),  (5),  and  (7 )  is  included  in  the 
System/Cost  Effectiveness  Notebook,  RADC-TR-68-352,  dated  April  1969.  This 
appendix  expands  on  the  application  procedure  for  methods  (1 )  and  ( 3  ) ,  and  adds 
the  procedures  for  methods  (2),  (4),  and(6),  the  Lagrangian  method  with  priority 
lists,  the  direct  comparison  (direct  search)  method,  and  the  gradient  projection 
method  of  apportionment,  respectively.  The  procedures  for  ( 5)  linear  programming 
and  (7 )  calculus  of  variations  are  commonly  used  in  system  analyses.  Based  on  this 
fact,  the  procedures  for  these  two  methods  oovered  in  the  Notebook  are  in  sufficient 
detail  for  most  applications  an^  are  iwt^xpanded  further  in  this  appendix. 

Prior  to  the  implementation  of  any  of  the  methods  described  herein,  the  following 
must  be  determined; 

•  The  nature  of  the  output  to  be  maximized  or  minimized 

•  The  transfer  functions  relating  the  output  to  the  input  variables 

•  The  constraints  placed  upon  outputs  and/or  specific  input  variables. 

If  specific  input  and/or  output  variables  are  constrained  by  limiting  values  due  to 
considerations  such  as  resources  available,  mission  performance  and  operational 
demands,  and  system  compatibility  requirements,  then  it  is  necessary  that  planned 
design  values  for  these  variables  be  within  the  existing  limitations.  This  restriction 
on  the  values  of  the  variables  may  be  expressed  mathematically  as: 

fjj  5.  C jj  »  f°r  k  =  1 . °  (1) 


or 


fk  >C 


k 


where 

c  is  the  number  of  constraints 

f^  is  the  planned  design  value  of  the  k-th  constrained  variable;  and 
C  is  i,he  upper  or  lower  limit  on  the  k-th  constrained  variable. 
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To  simplify  the  procedural  description  for  the  various  apportionment  methods,  only 
constraints  of  the  form  f^  <_  shall  be  considered  to  be  present  for  the  system. 
However,  by  replacing  and  C 
may  be  extended  to  constraints  of  the  form  f^  _>  .  Additionally,  an  output  value, 

as  referred  to  in  this  appendix,  will  be  used  to  denote  either  its  true  value  or  its 
value  resulting  from  a  change  of  sign,  according  to  whether  the  true  output  is  to  be 
maximized  or  minimized.  The  output  then  can  be  uniformly  interpreted  as  a  function 
to  be  maximized.  Also,  the  terms  input  and  output  are  used  in  the  general  sense  that 
they  may  represent  a  sing'e  variable  or  an  ensemble  of  variables. 


^  by  -f^  and  -C^  respectively,  the  procedures 


The  Lagranalan  Method 

A  general  method  for  establishing  an  input  that  will  optimize  an  output  involves  the 
use  of  numbers  referred  to  as  Lagrange  multipliers.  The  procedure  for  using  such 
a  method  consists  of  the  follr  tteps: 


( 1 )  For  an  output  vt  .  E ,  formulate  a  modified  output  variable 

by  subtracting  from  it  terms  relating  to  the  constraints.  This 
modified  output  variable  is  the  variable  to  be  optimized  and  is 
given  by  the  following  equation: 


c 

E  -  2  Vfk  -  V 

k=  1 


(2) 


The  quantities  A^  are  the  Lagrange  multipliers.  Physically,  they 
represent  penalties  for  violation  of  the  constraints.  These  penalties 
are  charged  against  the  output  variable.  The  values  for  the  Lagrange 
multipliers  are  chosen  so  that  when  the  modified  output  variable  is 
optimized,  none  of  the  constraints  is  violated. 

( 2 )  Perform,  a  partial  Hlffprent.iat.ion  of  the  modified  output  variable  with 
respect  to  each  of  the  input  variables  and  equate  to  zero.  Each  of  the 
resulting  partial  derivatives  will  be  zero  at  the  optimum  solution.  As 
a  consequence  of  this  operation,  a  set  of  equations  is  obtained,  with 
the  number  of  equations  in  the  set  corresponding  to  the  number  of  input 
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variables.  Thus,  if  there  are  N  variables  a,  then  the  following  N 
equations  will  be  formulated: 


da  . 

1  k-l 


afk 

=0.  for  1=1 


N 


(3) 


This  set  of  N  equations,  plus  the  c  constraint  relationships  are 
represented  by  the  formula  f.  <_  C^,  will  constitute  (N  +  c)  equations 
with  a  total  of  (N  +  c)  unknowns.  These  unknowns  will  consist  of  N 
input  ufljiflhlfla- and  n  T^crranya  multiplier 8 .  .  r 

Solve  the  (N  +  c)  equations .  One  solution  method  is  to  solve  the  first 
N  equations  for  the  input  variables  by  Newton's  iterative  method,  with 
fixed  values,  close  to  zero,  for  the  Lagrange  multipliers.  If  any  of  the 
constraints  is  violated,  the  values  of  the  corresponding  Lagrange  multi¬ 
pliers  should  be  changed,  and  the  solution  redetermined.  Repeat  this 
process  until  each  multiplier  approaches  the  lowest  value  such  that  none 
of  the  constraints  are  violated. 

The  procedure  for  using  Newton's  method  in  solving  the  first  N  equa¬ 
tions  for  the  values  of  the  inputs  a,  with  fixed  values  of  the  Lagrange 
multipliers  A.,  is  as  follows: 

(a)  Make  an  initial  estimate  of  tne  input  values  a 

(b)  Calculate  for  these  inputs  all  the  quantities  contained  in  the  follow¬ 
ing  system  of  linear  equations,  except  the  unknowns  A  : 


N 

y^/dctiK  =  -gj,  for  j  =  1.....N, 
k=l 
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where  Is  defined  by 
N 

0E  V 

SJ"  da  j  2^k k 

J  k-l 

(c)  Solve  for  the  unknowns  A  j 

(d)  Add  /ij  to  for  all  i  from  1  to  N 

(e)  Repeat  the  process  from  Step  (b)  until  each  input  value  ot^ 

— — . . . . 

A  method  such  as  Newton's  method  Is  likely  to  require  the  use  of  a  computer.  If 
several  input  variables  interactively  Influence  the  output,  but  such  interactions  are 
insignificant,  a  simplified  procedure  involving  the  use  of  priority  lists  will  converge 
and  can  be  used. 

Lagrangian  Method  With  Priority  Lists 

With  this  method,  the  value  of  only  one  input  variable  is  improved  at  each  step.  The 
word  "priority"  connotes  that  for  each  3tep  the  input  variables  are  ranked  according 
to  the  magnitude  of  improvement  in  the  output  function  resulting  from  a  cnange  in  the 
value  of  an  individual  input  variable.  At  each  step,  only  the  value  of  the  input  variable 
with  the  highest  ranking  is  improved. 

A  Lagrange  multipler  is  the  ratio  of  the  rate  of  change  of  the  output  function  to  the 
rate  of  change  of  the  constraint  function.  Alternately,  it  may  be  interpreted  as 
representing  the  ratio  of  the  rate  at  which  the  output  function  is  optimized  to  the  rate 
that  the  slack  is  taken  up  in  the  constraint  as  the  input  value  is  changed.  In  general, 
this  interpretation  of  Lagrangian  multipliers  applies  to  the  case  where  there  are  any 
number  of  constraints.  A  slack  is  the  margin  by  which  the  corstraint  is  not  violated. 
For  example,  if  the  constraint  is  f^  <_  C^,  then  the  slack  is  Cj  -  fj . 


Sf, 


k 

3a 


j 


(4) 
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For  the  case  where  only  one  constraint  exists ,  the  Lagrange  multiplier  may  be 
denoted  as  A  ,  and  be  expressed  an: 


A 


1 


\i)i 


dE  fSh 
da  i  9ai 


(5) 


The  values  A^j,  fcr  1  =  1  to  N,  may  be  different  from  each  other  for  the  steps  of 

the  iterative  solution,  but  will  converge  to  a  common  value  Ky  ft  the  last  iteration. 

Equation  (5)  is  the  one -constrain*  equivalent  of  equation  (3). 

-  _  -  m  si«-  -ii  tm  >  is  -  r-  —  i-  --  ----  -  — ^ — 

For  the  case  of  one  constraint  the  procedure  for  optimization  is  as  follows: 

(1)  Choose  a  tentative  value  for  each  input  variable  so  that  none  of  the  constraints 
are  violated.  Calculate  the  derivatives  of  the  output  function  E  and  the  con¬ 
straint  function  fj  with  respect  to  each  input  variable  a^.  Compute  the  ratios. 
These  ratios  are  priority  numbers  designated  A^^  according  to  equation  (5). 
One  of  these  ratios  is  computed  for  each  Input  variable  or.  Arrange  the  input 
variables  in  a  priority  list  by  descending  order  of  their  corresponding  priority 
numbers . 

(2)  Increase  (or  decrease;,  the  value  of  the  first  listed  input  that  will  improve  the 
output  until  either  the  output  is  optimized  for  that  variable  or  any  constraint 
depending  on  that  variable  is  reached.  It  will  be  necessary  tc  recompute  the 
output  and  the  constraint  as  the  input  is  varied. 

(3)  Recalculate  the  priority  numbers  A^^  and  reorder  the  list  if  necessary. 

(4)  Back  away  from  the  constraint  by  adjusting  the  value  of  the  last  input  on  the 
priority  list  in  such  a  way  as  to, introduce  slack  into  the  constraint  inequalities, 
even  if  this  represents  a  decrease  in  the  output  function.  The  amount  of  this 
adjustment  should  be  small  or  moderate,  such  as  a  unit  step. 

(5)  Iterate  these  steps  until  all  the  priority  numbers  are  as  close  together  as 
possible.  For  a  continuous  method,  they  may  theoretically  be  made  equal. 
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The  resulting  values  of  the  input  variables  constitute  an  optimum  solution.  If  there 
are  more  than  one  constraint,  the  method  may  be  applied  by  considering  one  con¬ 
straint  at  a  time  and  avoiding  those  input  values  which  may  cause  any  of  the  con¬ 
straints  to  be  violated.  If  this  procedure  is  unmanageable,  an  alternative  Is  to 
treat  all  constraints  simultaneously.  For  each  input  variable  and  at  each  step, 
this  is  accomplished  by  constructing  a  priority  number  relating  to  all  constraints, 
and  proceeding  as  in  the  case  of  one  constraint.  Such  a  priority  numoer,  for  the 
i-th  input  variable  is  generated  by  the  following  process: 


For  each  constraint,  such  as  the  k-th  constraint,  multiply  each  priority 
number  X^  by  the  9lack  in  the  k-th  constraint,  and  call  the  result 


(2)  For  each  i-th  input  variable,  determine  the  value  of  k  fer  which  X*,^ 
is  the  smallest.  This  value  is  the  priority  number  based  upon  all  con¬ 
straints  to  use  for  the  i-th  input  variable. 


In  order  lor  the  Lagrangian  method  with  priority  lists  to  ore  vide  an  optimum  solution 
efficiently,  the  partial  derivative  of  both  the  constraint  and  output  functions  with  respect 
to  each  of  the  inputs  or  ,  namely  df/det .  and  dK/d&. ,  should  be  functions  principally 
of  only  a.  and  independent  of  other  inputs.  A  simple  transformation,  such  as  a 
logarithmic  transformation,  may  be  required  to  provide  the  independence,  especially 
when  the  output  function  is  a  product  of  inputs.  If  the  partial  derivatives  are  signifi¬ 
cantly  dependent  on  the  other  inputs ,  convergence  of  the  Lagrangian  method  with 
priority  lists  to  an  optimum  solution  will  be  slow.  In  such  situations,  the  use  of  the 
classical  Lagrangian  method  will  be  more  efficient,  with  the  resulting  equations 
solved  by  Newton's  method  or  a  comparable  method. 


Dynamic  Programming  Method 

The  dynamic  programming  method  involves  the  optimization  of  one  input  at  a  time 
for  a  multi-input  situation.  This  method  is  based  on  the  principle  that  if  the  value 
chosen  for  a  specific  input  is  optimized,  then  the  values  for  the  remaining  inputs 
to  be  chosen  to  optimize  the  output  are  subject  to  the  decision  made  on  the  first  input. 
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Problems  most  readily  solved  by  the  method  of  dynamic  programming  are  those 
which  can  be  represented  in  a  form  in  which  the  contribution  of  each  input  to  the 
output  E  is  additive,  namely 

e  *  gx  ( ax)  +  %2  ( a2)  +  •  •  •  gN  ( a  N>  (6) 

and  where  the  constraint  is  a  linear  combination  of  contributing  inputs  a  ,  if  there 
are  M  number  of  inputs  out  of  N  inputs  a  which  contribute  to  such  a  constraint, 
then  the  constraint  may  be  mathematically  described  as  follows: 

M 

C  ,  Sj  o*|,  a  .  >  0  for  1  =  1,  2,  3 . M. 

In  order  to  implement  the  dynamic  programming  method,  a  series  of  functions  of 
an  arbitrary  variable  x,  for  x  between  0  and  C,  is  defined: 

^(x)  =  gx  (x/Sj); 

f.  (x)  =  maximum  [g  (x  /s.)  +  f.  .  (x  -  x  )]  ,  1=2,  3,  4 . M. 

OSXjlx  111  1-1  1 

Let  hr  ('x)  be  the  value  of  x.  for  which  the  maximum  stated  in  the  preceding  equation 
is  attained.  Each  function  f.(x)  is  an  output  function  which  sequentially  adds  the  in¬ 
fluence  of  the  i-th  input  to  the  influence  of  the  previous  inputs .  The  value  of  L  (x) 
for  any  x  Is  equivalent  to  the  maximum  value  cf  the  sum 

E  W- 

J-l 

where  the  inputs  are  to  satisfy  the  inequality 
Vs  «  <  x. 

j  j  - 

j=l 
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The  procedure  for  arriving  at  an  optimum  solution  involves  the  following  operations: 

(1)  Calculate  and  tabulate  the  functions  f^  (x)  through  f^  (x)  and  hg(x)  through 
hM(x)  for  values  of  x  ranging  from  OtoC.  This  procedure  represents,  at 
each  step,  an  optimization  problem  with  one  more  input  than  was  present  at  the 
previous  step. 

(2)  Find  the  value  of  x  between  0  and  C  such  that  fj^(x)  is  a  maximum.  De  ¬ 
note  this  value  of  x  as  x{M).  The  quantity  x{i)  generated  at  any  i-th  step  (in  this 
and  the  next  operation)  represents  the  value  taken  on  by  the  following  sum  when 
the  values  of  are  chosen  optimally: 

- 2— - 

3=1 

(3)  Compute  for  each  value  of  i  from  M  down  to  2,  the  function  h^xfi)]  .  Denote 
this  value  as  X.  Then  x(i  -  1)  =  x(i)  -x..  The  optimum  value  of  each  a.  is 
then  Xj/s^. 

Sometimes  the  functions  g.(  « ,)  are  defined  for  a  continuous  spectrum  of  values  of 

or ,  rather  than  for  a  limited  range.  Then  each  function  generated  for  values  of  x 

between  0  and  C  is  defined  analytically  for  a  discrete  set  of  R  alternate  values 

of  x  from  0  to  C  ,  such  as  0,  C/(R  -  1),  2C/(R  -  1), ....  C,  where  R  is  some 

integer.  In  this  case,  the  algorithm  for  the  dynamic  programming  solution  takes  on 
2 

the  order  of  MR  /2  comparisons  and  calculations  of  the  functions  g. 

If  the  output  E  is  a  function  (such  as  a  product)  of  inputs,  a  transformation,  such  as 
logarithmic,  may  be  applied  to  both  inputs  and  output  so  that  inputs  and  output  will  be 
in  the  form  of  equation  (6). 
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The  method  of  dynamic  programming  Is  feasible  when  the  following  conditions  are 
present: 

•  The  partial  derivative  d  E/da  j  of  the  output  with  respect  to  any  i-th  input 
does  not  significantly  depend  on  the  value  of  the  other  inputs.  This  implies 
that  the  effects  of  the  inputs  upon  the  output  are  mutually  independent. 

•  The  service  of  an  automatic  computer  is  available. 

Direct  Comparison  Method  (Direct  Search) 

The  simplest  method  to  understand  for  optimizing  the  output  of  a  system  is  to  compute 
the  output  associated  with  each  combination  of  input  values  for  which  none  of  the  con¬ 
straints  are  violated,  and  to  determine  the  combination  having  the  optimum  output. 

This  simple  comparison  method  is  very  laborious  due  to  the  number  of  alternatives 
Involved .  i or  example,  ii  tnere  ar5“  M  ihj5uts  &H8" TT"  SltSTlflltlVe  valtws'for'tlnj  " 
i-th  input,  the  number  of  alternatives  to  be  investigated  is  x  Kg  x  .  .  .  .  xR^. 

For  4  alternates  to  each  of  10  input  variables,  the  number  of  alternatives  is  over  a 
million  total  combinations,  unless  a  large  number  of  alternatives  can  be  eliminated 
through  knowledge  of  the  constraints  involved.  Even  if  a  computer  is  available,  the 
method  of  direct  comparison  is  practical  only  when  the  numbers  of  inputs  and  alter¬ 
native  values  for  each  input  are  sufficiently  small  to  be  manageable. 

Gradient  Projection  Method 

The  gradient  projection  method  is  characterized  by  a  change  in  the  path  of  optimiza¬ 
tion  whenever  there  exists  a  potential  that  a  constraint  may  be  violated.  The  procedure 
for  using  this  method  is  as  follows: 

(1)  Begin  with  an  initial  approximation  for  the  inputs  a  such  that  no  constraints  are 
violated.  Calculate  the  output  E  and  the  partial  derivatives  fiE /da  .correspond¬ 
ing  to  these  inputs. 

(2)  Find  those  constraints,  if  any,  for  which  there  is  little  or  no  slack.  This  implies 
that  and  f^  are  approximately  equal.  Call  these  critical  constraints,  and 
let  b  represent  the  number  of  such  constraints  out  of  a  total  of  c  constraints . 
Thus,  b  5Lc  .  Arrange  the  c  constraints  so  that  the  b  critical  constraints 
occur  first.  This  is  solely  for  the  purpose  of  notational  convenience.  For  each 
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of  the  critical  constraints,  calculate  the  derivative  of  the  constrained  function  with 
respect  to  the  input  variables.  Then  add  to  each  input  ot^  as  follows: 


D  df 

k=l 


where 


4,  =[V  af— 

k  ^  5a.  6b  ^  da.1 

.  .  1  1  •  ,  1 

1=1  1=1 


The  coefficient  K  is  independent  of  i  .  It  is  chosen  so  that  (1)  the  output  func- 

£I8ft  *  E^T*8^ut^T&TTtlffTietriftput s  c*.  is  greater  than  tirat  'cOTrtbutSfl  for  Tltf - 

inputs  used  on  the  previous  iteration  ttnd  (2)  no  constraint  is  violated  by  more 
than  some  fixed  small  amount.  It  is  advisable  to  choose  K  as  large  as  possible 
consistent  with  this  rule.  Iterative  methods  can  be  used  to  find  the  largest  per¬ 
missible  value  of  K  at  each  step. 


(3)  Change  each  input  a.  to  the  fallowing: 


where 

D 

and  £ ^  is  the  amount  by  which  the  k-th  constraint  is  violated.  This  amount 
is  zero  or  f^  -  C^,  whichever  is  greater. 

(4)  Repeat  steps  (2)  and  (3).  Continue  the  process  until  the  output  E  cannot  be 
significantly  improved. 


The  method  of  gradient  projection  normally  will  require  the  use  of  a  computer. 
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